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(54) Information processing apparatus and control method therefor 



(57) A server machine receives a printing job. in- 
cluding information to be printed, and a first print param- 
eter, and based on that information, sets a second print 
parameter that is suitable for the information and also 
alters the first print parameter. A printer prints the re- 
ceived Information based on the printing parameters 
that are set or changed. Further, users who submit in- 
formation that is received are identified and the printed 
results are stored at storage locations that differ for each 



user. In addition, information may be requested from an 
externa! device, and the requested information printed 
when It Is received. Furthermore, Information that Is In- 
put may be transmitted to extemal devices to request 
that those devices process that information. Moreover, 
when an output device that is designated by a received 
output instruction is a locally owned apparatus, the ap- 
paratus performs the processing as instructed. When a 
designated output device is another device, external 
transmission of the output instruction is perfonned. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

The present invention relates to an information 
processing apparatus for outputting intormation, and a 
control method therefor In particular, the present inven- 
tion pertains to an information processing apparatus 
that is one of a plurality of apparatuses that communi- 
cate with each other, one apparatus outputting informa- 
tion in response to the receipt of an instruction from an- 
other apparatus, or requesting a required process from 
another apparatus, and a control method therefor 

Related Background Art 

A conventional printing apparatus can perform 
printing in consonance with an objective by altering the 
setups for various printing parameters, such as the pa- 
per size, the number of printed copies, the printing 
speed and the printing quality. 

However, among the factors involved in the setting 
up of printing parameters, there are certain elements, 
such as urgency, economy and print quality, tliat in some 
cases may be in conflict, and as the number of param- 
eters to be set is therefore increased, it is difficult for a 
user to set the appropriate parameters. Even when a 
user knows which parameter values are appropriate, for 
the user it Is inconvenient to set the parameters one after 
another. And while a complex setup operation will not 
be required when default values are employed, it is not 
possible to establish optimal parameter values for Indi- 
vidual documents. 

A single printer on a network can be used in a plu- 
rality of users. In this case, a document submitted by 
one user is mixed with a document submitted by another 
user Therefore, when, for example, two users submit a 
plurality of documents, the results obtained as the out- 
put must be sorted. When a document is left on an out- 
put tray, the contents of the document must be exam- 
ined in order to determine who submitted the document. 

An information processing apparatus, called a per- 
sonal computer (hereinafter referred to as a PC), han- 
dles electronic data. Therefore, physical information, 
such as information written on paper or a printed docu- 
ment that exists in real space is converted into electronic 
information by an input device, such as a scanner or a 
digital camera, so that a PC can process the information. 
When a person is to process electronic information 
stored in a PC, the electronic information must be con- 
verted into physical information by an output device, 
such as a printer or a display. 

Based on the fact that the output device is one of 
the peripheral devices attached to a PC, it can be con- 
trolled by the PC, not by another peripheral device. The 
information required for such control must be stored in 



the PC in an appropriate form. 

A user is to perform the following operation on a PC 
and a printer to convert electronic information stored in 
a PC into printed physical information, as is shown in 
Fig. 159. In this case, the PC must hold, in the form of 
a printer driver, information concerning the operating 
procedures for the printer. 

First, a user employs a printer driver held in the PC 
to send a printing instruction. Then, the PC sends a 
printing command to the printer. Upon the receipt of the 
printing command, the printer, unless it is busy, imme- 
diately initiates the printing of the instructed information. 
Following this, the user collects the printed document. 
The printing command includes the document data that 
is the printing target. The printing target must be de- 
scribed in a form that the printer can process. 

A PC can be used as a server terminal, as is shown 
in Fig. 160. In this case, the PC receives from a server 
each select data that is to be displayed on a screen in 
accordance with the transmission protocol, such as X 
Window System, and displays the data as prescribed by 
the instructions. 

Information read by a scanner can be transmitted 
to a printer for printing via a PC, as is shown in Fig, 161. 
Therefore, a scanner and a printer can together be em- 
ployed as a pseudo copier. It should be noted, however 
that a scanner driver and a printer driver must be in- 
stalled in the PC In advance, and the joint employment 
of the two devices must be specified. If conversion of 
the image format of the scanner into a format that the 
printer can process is required, the PC must perform 
such format conversion before transmitting the data. 
Further, the format conversion must be performed, as 
needed, at the discretion of a user 

A printing command for a specific printer must be 
directly transmitted to that printer In addition, printing 
target information must also be transmitted to the printer 
with the printing command from the PC. If the printing 
target information is to be transmitted to a device other 
than a PC, or to a printer in some cases, first the PC 
must acquire the information by communicating with an- 
other device, and must then transmit the infomnation to 
the printer 

The received printing target document is immedi- 
ately printed if printing is enabled. 

SUMMARY OF THE INVENTION 

It is one objective of the present invention to provide 
an information processing apparatus that can reduce 
the load placed on a user when performing an operation 
to implement the objective of processing, and a control 
method therefor 

It is another objective of the present invention to 
provide a printing apparatus that can perform printing 
by employing appropriate printing parameters conso- 
nant with the processing objective, without a complex 
operation being required, and a control method therefor 
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It is an additional objective of the present invention 
to provide a printing apparatus that pernnits a plurality of 
users to efficiently employ a single printer, and a control 
method therefor. 

It is a further objective of the present invention to 
provide an information processing apparatus that can 
handle a command for another output device and can 
perform a pre-process for outputting data from the out- 
put device, and a control method therefor. 

It is still another objective of the present invention 
to provide an information processing apparatus that can 
suspend received data instead of processing them, and 
a control method therefor. 

It is a still additional objective of the present inven- 
tion to provide an information processing apparatus 
wherein an output side can, as needed, from an appa- 
ratus or an external device, acquire and output informa- 
tion to be processed, and a control method therefor. 

It Is a still further objective of the present invention 
to provide an information processing apparatus that can 
by itself employ an information resource belonging to an 
external device. 

It is yet another objective of the present invention 
to provide an information processing apparatus that can 
employ a resource belonging to an external device to 
process information input by the apparatus. 

According to one aspect, the present invention 
which achieves these objectives relates to a printing ap- 
paratus comprising: 

reception means for receiving information to be 
printed and a first printing parameter; 
determination means for employing the information 
that is received to determine a second parameter 
suitable for the information; 

setup means for setting up the first and the second 
parameters; and 

printing means for printing the information based on 
the first and the second printing parameters set up 
by the setup means. 

According to another aspect, the present invention 
which achieves these objectives relates to a printing ap- 
paratus comprising: 

reception means for receiving information to be 
printed; 

identification means for identifying a user for the in- 
formation that is received; 
printing means for printing the information; 
printing results storage means having a plurality of 
storage locations; and 

control means for storing^ at a different location in 
the printing results storage means, printing results 
obtained by the printing means for each user who 
is Identified by the identification means. 

According to another aspect, the present invention 



which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

communication means for communicating with an 

5 external device; 

output means for outputting information; and 
control means for requesting information from the 
external device, for receiving the information from 
the external device, and for permitting the output 

10 device to output the information. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

IS 

communication means for communicating with an 
external device; 

input means for receiving information; 
processing means for processing the information 
20 received by the input means; and 

control means for transmitting the information 
through the communication means to the external 
device and requesting the external device to proc- 
ess the information. 

25 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

30 output means for outputting information; 

acceptance means for accepting an output instruc- 
tion, including designation information included for 
the designation of an output device; 
detection means for detecting an apparatus that is 

35 identified in the designation information; 

output control means tor permitting the output 
means to execute the output instruction when the 
apparatus detected by the detection means is the 
information processing apparatus, andfortransmit- 

40 ting the output instruction to an external device 

when the apparatus detected by the detection 
means is other than the information processing ap- 
paratus. 

45 According to another aspect, the present invention 

which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

communication means for communicating with an 

50 external device; 

processing means for processing information; 
management means for receiving from the external 
device through the communication means informa- 
tion to be processed and for managing the informa- 

55 Won by employing a plurality of management states, 
including a process pending state and a process 
wait state; and 

control means for permitting the processing means 
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to process the information. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

reception means for receiving a process to be per- 
formed by another device; 

processing means for performing a predetermined 
process required for the performance of the process 
received by the reception means; and 
output means for outputting the results obtained by 
the processing means. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

reception means for receiving designation infomia- 
tion that identifies a target to be processed; 
acquisition means for acquiring the target identified 
in the designation information received by the re- 
ception means; 

processing means for performing a process for the 
target acquired by the acquisition means; and 
output means for outputting the results obtained by 
the processing means. 

According to another aspect* the present invention 
which achieves these objectives relates to an informa- 
tion processing apparatus comprising: 

reception means for receiving information to be 
processed; 

processing means for processing the information; 
and 

conversion control means for controlling a conver- 
sion of the information that is received by the recep- 
tion means into information, described using a de- 
scription language, that is to be processed by the 
processing means. 

According to another aspect, the present invention 
which achieves these objectives relates to a printing 
method comprising: 

a reception step of receiving information to be print- 
ed and a first printing parameter; 
a determination step of employing the Information 
that is received to determine a second parameter 
suitable for the information; 

a setup step of setting up the first and the second 
parameters; and 

a printing step of printing the information based on 
the first and the second printing parameters set up 
at the setup step. 

According to another aspect, the present invention 



which achieves these objectives relates to a printing 
method comprising: 

a reception step of receiving information to be prlnt- 

5 ed; 

an identification step of identifying a user for the in- 
formation that is received; 
a printing step of printing the information; 
a printing results storage step of storing printing re- 
10 suits in one of a plurality of storage locations; and 
a control step of storing printing results at a different 
location for each user who is identified at the iden- 
tification step. 

According to another aspect, the present invention 
which achieves these objectives relates to an Informa- 
tion processing method comprising: 

a communication step of communicating with an ex- 
ternal device; 

an output step of outputting information; and 
a control step of requesting information from the ex- 
ternal device, of receiving the information from the 
external device, and of permitting the output device 
to output the information. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

a communication step of communicating with an ex- 
ternal device; 

an input step of receiving information; 
a processing step of processing the information re- 
ceived at the input step; and 
a control step of transmitting the information to the 
external device at the communication step and of 
requesting the external device to process the infor- 
mation. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

an output step of outputting information; 
an acceptance step of accepting an output instruc- 
tion, including designation information included for 
the designation of an output device; 
a detection step of detecting an apparatus that is 
identified in the designation information; 
an output control step of permitting the output 
means to execute the output instruction when the 
apparatus detected at the detection step is the in- 
formation processing apparatus, and of transmitting 
the output instruction to an external device when the 
apparatus detected at the detection step is other 
than the information processing apparatus. 
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According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

a processing step of processing information; 5 
a management step of receiving information to be 
processed from the external device through a com- 
munication unit for communicating with the external 
device, and of managing the information by employ- 
ing a plurality of management states, including a 
process pending state and a process wait state; and 
a control step of permitting the processing means 
to process the information. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

a reception step of receiving a process to be per- 
formed by another device; 

a processing step of performing a predetenmined 
process required for the performance of the process 
received at the reception step; and 
an output step of outputting the results obtained at 

the processing step. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

a reception step of receiving designation intorma- 
tion that identifies a target to be processed; 
an acquisition step of acquiring the target identified 
in the designation information received at the recep- 
tion step; 

a processing step of performing a process for the 
target acquired at the acquisition step; and 
an output step of outputting the results obtained at 

the processing step. 

According to another aspect, the present invention 
which achieves these objectives relates to an informa- 
tion processing method comprising: 

a reception step of receiving information to be proc- 
essed; 

a processing step of processing the information; 
and 

a conversion control step of controlling a conversion 
of the information that is received at the reception 
step into information, described using a description 
language, that is to be processed at the processing 
step. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 



comprising codes for causing the computer to perform: 

a reception step of receiving information to be print- 
ed and a first printing parameter; 
a determination step of employing the information 
that is received to determine a second parameter 
suitable for the information; 
a setup step of setting up the first and the second 
parameters; and 

a printing step of printing the information based on 
the first and the second printing parameters set up 
at the setup step. 

According to another aspect, the present Invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform; 

a reception step of receiving informatbn to be print- 
ed; 

an identification step of Identifying a user for the in- 
formation that is received; 
a printing step of printing the information; 
a printing results storage step of storing printing re- 
sults in one of a plurality of storage locations; and 
a control step of storing printing results at a different 
location for each user who is identified at the iden- 
tification step. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 

a communication step of communicating with an ex- 
ternal device; 

an output step of outputting information; and 
a control step of requesting information from the ex- 
ternal device, of receiving the information from the 
external device, and of permitting the output device 
to output the information. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 

a communication step of communicating with an ex- 
ternal device; 

an input step of receiving information; 
a processing step of processing the information re- 
ceived at the input step: and 
a control step of transmitting the information to the 
external device at the communication step and of 
requesting the external device to process the infor- 
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mat ion. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for s 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 

an output step of outputting information; 
an acceptance step of accepting an output instruc- 
tion, including designation information included for 
the designation of an output device; 
a detection step of detecting an apparatus that is 
identified in the designation information; 
an output control step of permitting the output 
means to execute the output instruction when the 
apparatus detected at the detection step is the in- 
formation processing apparatus, and of transmitting 
the output instruction to an external device when the 
apparatus detected at the detection step is other 
than the information processing apparatus. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes lor causing the computer to perform: 

a processing step of processing information; 
a management step of receiving information to be 
processed from the external device through a com- 
munication unit for communicating with the external 
device, and of managing the information by employ- 
ing a plurality of management states, including a 
process pending state and a process wait state; and 
a control step of permitting the processing means 
to process the information. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 

a reception step ot receiving a process to be per- 
formed by another device; 

a processing step of performing a predetermined 
process required for the performance of the process 
received at the reception step; and 
an output step of outputting the results obtained at 
the processing step. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 



a reception step of receiving designation informa- 
tion that identifies a target to be processed; 
an acquisition step of acquiring the target identified 
in the designatbn Information received at the recep- 
tion step; 

a processing step of performing a process for the 
target acquired at the acquisition step; and 
an output step of outputting the results obtained at 
the processing step. 

According to another aspect, the present invention 
which achieves these objectives relates to a computer- 
readable storage medium storing a printing program for 
controlling a computer to perform printing, the program 
comprising codes for causing the computer to perform: 

a reception step of receiving information to be proc- 
essed; 

a processing step of processing the information; 
and 

a conversion control step of controlling a conversion 
of the information that is received at the reception 
step into information, described using a description 
language, that is to be processed at the processing 

step. 

Other objectives and advantages those discussed 
above shall be apparent to those skilled in the art from 
the description of a preferred embodiment of the Inven- 
tion which follows. In the description, reference is made 
to accompanying drawings, which form a part thereof, 
and which illustrate an example of the Invention. Such 
example, however, is not exhaustive of the various em- 
bodiments of the invention, and therefore reference is 
made to the claims which follow the description for de- 
termining the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 Is a block diagram illustrating the arrange- 
ment of an information processing system accord- 
ing to a first embodiment of the present invention; 
Fig: 2 is a diagram illustrating the functional ar- 
rangement according to the first embodiment; 
Fig. 3 Is a diagram Illustrating the hardware ar- 
rangement of the individual units according to the 
first embodiment; 

Fig. 4 is a flowchart showing the processing per- 
formed for the first embodiment; 
Fig. 5 is a diagram showing a process for selecting 
an optimal printer from a plurality of printers and 
performing a printing job with It; 
Fig. 6 is a diagram for explaining a case where a 
controller is used; 

Fig. 7 is a diagram showing a case where a docu- 
ment Is read by a scanner for transmission to a spe- 
cific printer; 

Figs. B, 9 and 10 are diagrams illustrating a case 
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where a document is read by a scanner for trans- 
mission to a specific printer that the scanner can not 
control; 

Fig. 11 is a diagram illustrating a case where infor- 
mation concerning the state of a printer is distribut- s 
ed; 

Fig, 12 is a flowchart showing the processing per- 
formed an eighth embodiment; 
Fig. 1 3 is a table containing remarks for determining 
whether or not an advance notice should be trans- io 
mitted in consonance with job types and conditions; 
Figs, 14A and 14B are respectively diagrams of a 
case where a user is informed in advance of infor- 
mation to be filed and a case where unnecessary 
information is abandoned; ts 
Fig. 15 is a flowchart showing the processing for a 
ninth embodiment; 

Fig. 16A is a diagram showing the transmission of 
information lor the ninth embodiment; 
Fig. 16B is a diagram showing the transmission of 20 
information when an apparatus corresponding to 
the object of a job is not present; 
Fig. 17 is a diagram showing an example display 
for a window by which an optimal method is pro- 
posed to a user; 2S 
Fig. 18 is a flowchart showing the detailed proce- 
dure lor job execution; 

Fig. 19 is a diagram showing an example of classi- 
fied information to be read; 

Fig. 20 is an example job table; 30 
Fig. 21 is a diagram showing an example printing 
window; 

Fig. 22 is an example job table; 

Fig. 23 Is a diagram showing the contents of <file 

A>; 35 

Fig. 24 is a diagram showing an inquiry window; 

Fig. 25 is an example job table; 

Fig. 26 is a diagram showing example scheduling 

data; 

Fig. 27 is a diagram showing an example user que- 40 

ry: 

Fig. 28 is an example job table; 

Fig. 29 is an example job table; 

Fig. 30 is a diagram showing an example change in 

the status of a printer; 4S 

Fig. 31 is a table showing printer statuses; 

Fig. 32 is an example job table; 

Fig. 33 is a diagram showing a query window; 

Fig. 34 is an example job table; 

Fig. 35 is a diagram showing an example printer 

change status; 

Fig. 36 is a table for displaying planning and action 
rules; 

Fig. 37 Is a table for displaying planning and action 
rules; ss 
Fig. 38 is a diagram showing actions and premise 
conditions for an object; 

Fig. 39 is a table for example apparatus properties; 



Fig. 40 is a table for example apparatus statuses; 
Figs. 41 A and 41 B are diagrams showing states 
where a plurality of apparatuses are connected to 
a network; 

Fig. 42 is a diagram showing a functional arrange- 
ment for perfonning the processing for a fourteenth 
embodiment; 

Fig. 43 is a main flowchart showing the processing 
for the fourteenth embodiment; 
Fig. 44 is a flowchart showing the processing for 
controlling other apparatuses; 
Fig. 45 is a flowchart showing the processing per- 
formed by one's own apparatus; 
Fig. 46 is a diagram showing an example where a 
printer other than a designated printer is employed 
for output; 

Fig, 47 is a diagram showing an example where a 
designated printer transfers a job to another printer; 
Fig. 48 is a diagram showing an example where a 
user's printer transfers a job to a printer at a user's 
destination; 

Fig. 49 is a flowchart showing the processing for a 
sixteenth embodiment; 

Fig. 50 is a conceptual diagram showing the 
processing for the sixteenth embodiment; 
Fig. 51 is a diagram showing transmission of a job 
for a seventeenth embodiment; 
Fig. 52 is a flowchart showing the processing per- 
formed by a print job automatic setup unit; 
Fig. 53 is a table showing printing periods and con- 
sumption 0I toner tor a plurality of printers tor print- 
ing a single character; 

Fig. 54 is a diagram showing the contents of a print 
job and parameters designated by a user; 
Fig. 55 is a flowchart showing the processing per- 
formed by a print job automatic change unit; 
Fig. 56 is a diagram showing the contents of a print 
job and parameters designated by a user; 
Fig. 57 is a diagram showing transmission of a job 
for a nineteenth embodiment; 
Fig. 58A is a diagram for explaining an example 
where parameters are set for a print job by employ- 
ing a natural language; 

Fig. 588 is a table showing the meanings of char- 
acter strings in the parameter setup, and request 
items with which to complete the meanings; 
Fig. 59 is a diagram showing an example where pa- 
rameters of a print job are set by using a document; 
Fig. 60 is a diagram showing transmission of a job 
for a twenty-first embodiment; 
Fig. 61 is a flowchart showing the processing per- 
formed by a print job simulation unit; 
Fig. 62 is a flowchart showing the processing per- 
formed by a printer system according to a twenty- 
second embodiment; 

Figs. 63A and 638 are diagrams illustrating the ex- 
ternal appearance of the printer system according 
to the twenty-second embodiment; 
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Fig. 64 is a flowchart showing the processing per- 
formed for a twenty-third embodiment; 
Fig. 65 Is a diagram showing the functional arrange- 
ment of a system according to the twenty-third em- 
bodiment; 5 
Fig. 66 is a diagram showing a system for perform- 
ing the overall process according to the twenty-third 
embodiment and input/output types relative to an 
external apparatus; 

Fig. 67 is a diagram showing an example where a 

schedule is extracted from electronic mall; 

Fig. 68 is a flowchart showing specific processing 

performed for the twenty-third embodiment; 

Fig. 69 is a diagram showing an example schedule 

conflict; 

Fig. 70 is a diagram showing an example where a 

user aurally queries a system; 

Fig. 71 is a flowchart showing the processing for a 

twenty-fourth embodiment; 

Fig. 72 is a diagram showing an example rearrange- 20 
ment of conflicting schedules; 
Fig. 73 Is a flowchart showing the processing for re- 
planning conflicting schedules; 
Fig. 74 is a flowchart showing the processing for re- 
plannlng responses; 25 
Fig. 75 is a diagram showing an overall image in- 
cluding the input/output of a system according to a 
twenty-sixth embodiment; 

Fig. 76 is a flowchart showing the overall processing 
performed by the system according to the twenty- 30 

sixth embodiment; 

Fig. 77 is a flowchart showing the processing per- 
formed by an input management unit; 
Fig. 78 is a flowchart showing the processing per- 
formed by a core unit; 3S 
Fig. 79 is a flowchart showing the processing per- 
formed by an output management unit; 
Fig. 80 is a flowchart showing data derivation 
processing; 

Fig 81 is a diagram showing an example document 40 
from which data are to be extracted; 
Figs. 82A and 82B are diagrams for explaining a 
specific block reading process; 
Fig. 83 which Is composed of Figs. 83A and 83B are 
flowcharts showing determination procedures in a 
process for referring to dale data; 
Fig. 84 is a diagram showing transmission of infor- 
mation according to a twenty-seventh embodiment; 
Fig. 85 is a diagram showing transmission of infor- 
mation according to a twenty-eighth embodiment; 
Fig. 86 is a diagram showing transmission of infor- 
mation according to the twenty-eighth embodiment; 
Fig. 87 is a flowchart showing the processing for the 
twenty-eighth embodiment; 

Fig. 88 is a table showing knowledge of a common ^5 
knowledge base; 

Fig. 89 is a table showing knowledge of a common 
knowledge base in a field specified on a cover page; 



Fig. 90 is a diagram showing an example where 
voice Is used to refer to processing history to per- 
form a process; 

Fig. 91 is a flowchart showing the processing per- 
formed according to a thirtieth embodiment; 
Fig. 92 is a diagram illustrating an example input 
document; 

Fig. 93 is a diagram showing the contents of a con- 
versation between a system and a user; 
Fig. 94 is a diagram showing an output document 
that a system prepares based on the judgement of 
the conversation; 

Fig. 95 is a flowchart for an example where a re- 
quired process is automatically performed after a 
user is queried; 

Fig. 96 is a diagram showing an example wherein 

a system is operated by a controller; 

Fig. 97 is a diagram showing an example status 

monitor; 

Fig. 98 is a diagram showing an example wherein 
a controller recognizes a target model and displays 
a corresponding Ul; 

Fig. 99 is a flowchart showing the processing per- 
formed by a controller for the example wherein the 
controller recognizes a target model and displays a 
corresponding Ul; 

Fig. 100 is a flowchart showing the processing per- 
formed by a target model for the example wherein 
the controller recognizes a target model and dis- 
plays a corresponding Ul; 

Fig. 101 is a diagram showing an example wherein 
a controller receives a Ul from a target model and 
displays it; 

Fig. 102 is a flowchart showing processing per- 
formed by a controller for the example wherein the 
controller receives a Ul from a target model and dis- 
plays it; 

Fig. 103 is a flowchart showing processing per- 
formed by a target model for the example wherein 
the controller receives a Ul from the target model 
and displays it; 

Fig. 104 is a diagram showing an example wherein 
a controller receives a Ul from a target model via a 
wireless LAN rather than directly, and displays it; 
Fig. 1 05 is a flowchart showing the processing per- 
formed by a controller for the example wherein the 
controller receives a Ul via a wireless LAN and dis- 
plays it; 

Fig. 106 is a flowchart showing the processing per- 
formed by a target model for the example wherein 
the controller receives a Ul via a wireless LAN and 

displays it; 

Fig. 1 07 is a flowchart showing the processing per- 
formed by a server for the example wherein the con- 
troller receives a Ul via a wireless LAN and displays 
it; 

Fig. 108 is a diagram showing an example wherein 
via a wireless LAN a controller receives a different 
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Ul for each user and displays it; 
Fig. 109 Is a flowchart showing the processing per- 
formed by a controller for the example wherein via 
a wireless LAN a controller receives a different Ul 
for each user and displays it; s 
Fig. 110 Is a flowchart showing the processing per- 
formed by a target model tor the example wherein 
via a wireless LAN a controller receives a different 
Ul for each user and displays it; 

Fig. 111 is a flowchart showing the processing per- io 
formed by a server for the example wherein via a 
wireless LAN a controller receives a different Ul for 
each user and displays it; 

Fig. 112 is a table showing a Ul determined in con- 
sonance with a target model and user identification 
information; 

Fig. 11 3 is a diagram illustrating an example where- 
in a model In front that is to be operated performs 
a function that the model does not have; 
Fig. 1 1 4 is a diagram illustrating an example where- 20 
in a model in front that is to be operated performs 
a function that the model does not have; 
Fig. 115 is a diagram showing an example per- 
formed when communication can not be performed 
directly with a model in front that is to be operated; 25 
Fig. 116 is a flowchart showing the processing per- 
formed by a controller according to a thirty-ninth 
embodiment; 

Fig. 117 is a diagram showing an example wherein 

an operation/action by a user and a time are jointly 30 

stored as history along with important associated 

information; 

Fig. 118 is a flowchart for the processing performed 
by a controller according to a fortieth embodiment; 
Fig. 1 1 9 is a flowchart for the processing performed 35 
by a target model according to the fortieth embodi- 
ment; 

Fig. 1 20 is a flowchart for the processing performed 
by a server according to the fortieth embodiment; 
Fig 121 Is a table showing example updated history 40 
information; 

Fig. 1 22 is a diagram illustrating an example where- 
in an operation is performed based on history; 
Fig. 123 is a diagram illustrating the example 
wherein the operation is performed based on histo- 4S 

ry; 

Fig. 1 24 is a diagram showing an example structure 
for a controller; 

Fig. 125 is a diagram showing another example 
structure for a controller; so 
Fig. 126 is a diagram showing an additional exam- 
ple structure for a controller; 

Fig. 1 27 is a diagram showing a functional arrange- 
ment according to a forty-second embodiment; 
Fig. 128 is a flowchart showing the processing for 55 
the forty-second embodiment; 
Figs. 1 29A, 1 29B, 1 29C. 1 29D, 1 29E and 1 29F are 
example task tables; 



Fig. 130 is a diagram showing an example input/ 
output apparatus that can operate another appara- 
tus; 

Fig. 131 is a diagram showing an example input/ 
output apparatus that can operate a system consist- 
ing of a plurality of apparatuses; 
Fig. 1 32 is a diagram illustrating example input/out- 
put apparatuses that can communicate with each 
other; 

Fig. 1 33 is a diagram illustrating an example input/ 
output apparatus that can acquire information from 
another apparatus; 

Fig. 1 34 is a diagram illustrating an example input/ 
output apparatus that can store information in an- 
other apparatus; 

Fig. 1 35 is a diagram illustrating an example input/ 
output apparatus that can send an insitructlon to an- 
other apparatus; 

Fig. 1 36 which is composed of Figs. 1 36A and 1 36B 
are flowcharts showing the processing for the task 
<COMMUNICATE>; 

Fig. 1 37 which is composed of Figs. 1 37A and 1 37B 
are flowcharts showing the processing for the task 
<PULL>; 

Fig. 1 38 which is composed of Figs. 1 38A and 1 38B 
are flowcharts showing the processing for the task 
<PUSH>; 

Fig. 1 39 which is composed of Figs. 1 39 A and 1 398 
are flowcharts showing the processing for the task 
<INDICATE>; 

Fig. 1 40 which is composed of Figs. 1 40 A and 1 408 
are flowcharts showing the processing for the task 
<RESPOND>; 

Fig. 141 is a flowchart showing the processing for 
a response task relative to an information request 
type request; 

Fig. 142 is a flowchart showing the processing for 
a response task relative to an information storage 
type request; 

Fig. 143 is a flowchart showing the processing for 
a response task relative to an Instructions type re- 
quest; 

Fig. 144 is a diagram illustrating an example pull 
session; 

Fig. 145 Is a diagram illustrating another example 
pull session; 

Fig. 146 is a diagram illustrating an additional ex- 
ample pull session; 

Fig. 147 is a diagram illustrating an example Hear 
On Demand session; 

Fig. 148 is a diagram illustrating a further example 
pull session; 

Fig. 149 is a diagram illustrating another example 
pull task; 

Fig. 150 is a diagram illustrating an additional ex- 
ample pull task; 

Fig. 151 is a diagram illustrating a session for a fur- 
ther example pull task; 
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Fig. 152 is a diagram illustrating an example push 
task; 

Fig. 153 is a diagram illustrating an example push 
session; 

Fig. 154 is a diagram illustrating an example mail 
transmission; 

Fig. 155 is a diagram illustrating example instruc- 
tions task INDICATE session; 
Fig. 156 is a diagram illustrating another example 
Instructions task INDICATE session; 
Fig. 1 57 is a diagram illustrating additional example 
instructions task INDICATE session; 
Fig. 158 is a diagram showing the flow of an oper- 
ation following the operational procedures per- 
formed for another apparatus; 
Fig. 1 59 is a diagram illustrating an example where- 
in a PC transmits a printing instruction to a printer; 
Fig. 160 is a diagram for explaining an example 
wherein a PC is employed as a server terminal; 
Fig. 161 is a diagram for explaining an example 
wherein a scanner and a printer are controlled by a 
PC; 

Fig. 162 is a diagram showing a relationship be- 
tween a print job status change and a process as- 
sociated with each status; 

Fig. 163 which is composed of Figs. 163Aand163B 
are flowcharts showing printing processing; 
Fig. 164 is a diagram showing a relationship be- 
tween a print job and its processing, and a user's 
operation; and 

Fig. 165 is a diagram showing an example display 
screen for a user for operating a print job. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The preferred embodiments of the present inven- 
tion will now be described while referring to the accom- 
panying drawings. 

[First Embodiment] 

Fig. 1 is a diagram Illustrating a system arrange- 
ment according to a first embodiment in which a PC 
(Personal Computer) 1 0 1 , a scanner 1 02, a color printer 
103 and a monochrome printer 104 are connected to a 
network. 

In this embodiment, when an apparatus in a system 
wherein a plurality of apparatuses are connected to- 
gether is Instructed to execute a specific job, the appa- 
ratus analyzes the object of the job by examining Its con- 
tents, and thus ascertains which job to execute. As a 
result of the analysis, the apparatus acquires necessary 
Information concerning the job and thereafter executes 
it. 

If for the execution of a job there is available a more 
effective method or another and better apparatus than 
an instructed method or an assigned apparatus, an In- 



struction is issued to the better apparatus or a notice is 
transmitted to a user to propose the use of the more ef- 
fective method. Further, as a consequence of the exam- 
ination of the contents of the job the instruction may be 
5 rejected. 

Job types are an operation Input by a user, an exe- 
cution of an instruction received from another appara- 
tus, the acquisition of results by analyzing a job, or a job 
that Is newly generated by an owned apparatus during 
10 an Idling period. When, for example, a document is to 
be read by a scanner and printed by a printer, the fol- 
lowing jobs are generated. 

(1 ) Analysis of the contents of an Instruction that is 
15 transmitted from a user to a scanner and that Is re- 
lated to a document set In the scanner; 

(2) A reading and analyzation process for a docu- 
ment, and an instruction process for instructing a 
printer to print a document that has been read, both 

20 of which are generated by analyzing an instruction 
from a user that Is received by the scanner (and the 
fact that the document has been set in the scanner). 

(3) Generation by the scanner of a printing instruc- 
tion for a printer during the instruction process. 

25 (4) Generation of a printing process by the printer 
as a result of an analysis of the printing instruction 
received from the scanner. 

A method for generating and managing these jobs 
30 will later be described in detail by referring to an eleventh 

and following embodiments. 

The procedures according to which a plurality of ap- 
paratuses execute the above described processes will 
be specifically described while referring to the drawings. 
3S Fig. 2 is a diagram illustrating the functional ar- 
rangement for performing the processing In this embod- 
iment. A job receptbn unit 201 receives a job from a 
user or another apparatus. The received job is regis- 
tered In a job table. A job analysis unit 203 reads and 
40 analyses a job registered in the job table 202. Another 
apparatus Information acquisition unit 204 acquires the 
attributes and the current states of the other apparatus- 
es that are connected. A state determination unit 207 
determines the state from the current states'of the other 
45 apparatuses. 

An optimum planning unit 206 makes an optimal 
plan for the execution of a job. A job execution determi- 
nation unit 207 determines whether a job should be ex- 
ecuted, or when the job is to be executed, and deter- 
so mines whether an owned apparatus or another appara- 
tus will execute the job. When another apparatus exe- 
cutes the job, another apparatus instruction unit 208 
sends an Instruction to another apparatus for the job ex- 
ecution. When the owned apparatus executes the job. 
55 a job execution unit 209 executes the job. An execution 
notification unit 210 notifies a user that the execution 
Instruction has been issued to another apparatus. 

Fig. 3 Is a diagram showing the hardware arrange- 
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ment of the units that perform the processing in this em- 
bod innent. 

An I/O 301 exchanges input/output data with exter- 
nal apparatuses. A CPU 302 executes a program and 
controls the individual units. A ROM 303 is used to store 
programs, which correspond to individual flowcharts 
that will be described later and which are to be executed 
by the CPU 302, and fixed data. A RAM 304 is used to 
temporarily store variables and intermediate data, such 
as the attributes and the current states of the other ap- 
paratuses acquired by the other apparatus information 
acquisition unit 204, that are generated during the 
processing. A program from an external source may be 
loaded into the RAM 304 and stored therein. 

Fig. 4 is a flowchart showing the processing per- 
formed for the first embodiment. 

At step SI 09, the contents of the job table are ini- 
tialized. At step S110, in order to determine whether a 
job has been input, a check is performed to determine 
whether or not a job has been input by a user, a job has 
been input by a device that can be detected by the sys- 
tem, from results obtained by analyzing the job, or a new 
job has been generated by an owned apparatus during 
idling. When a job has been input, at step S11 1 , the input 
job is added to the job table. At step S11 2, the job table 
is examined to determine whether there is job. If there 
is a job, at step S113the job is extracted. At step S114 
a received instruction is analyzed, and from the infor- 
mation thus obtained, the object of the job is acquired. 
At step S115, the analyzed instruction is employed to 
search for a job that is to be executed. At step S1 16 a 
job that is searched for at S11 5 is registered. 

At step S117 a check is performed to determine 
whether or not there is a job that has not yet been exe- 
cuted. If there is such a job, program control advances 
to step 8118. At step S118 a check is performed to de- 
termine whether or not the job can be executed. When 
it is ascertained that the job can not be executed, pro- 
gram control returns to step 8115 and a job that must 
be executed is searched for. At step 811 9 the job is ex- 
ecuted and program control returns thereafter to step 
S117. 

If a user sends an instruction, for example, to read 
a document using a scanner and to print the document 
using a printer, it is assumed that, as a result of the anal- 
ysis, the acquisition of a printed document is the object 
of a user In this case, a document reading and analysis 
process, which is generated by analyzing information 
received by the scanner from the user, and a process 
for instructing a printer to print the document that has 
been read are searched for as jobs. These processes 
will be described in detail during the course of the elev- 
enth and the following embodiments while referring to 
specific examples. 

Fig. 5 is a diagram showing a process for selecting 
from among a plurality of printers an optimal printer for 
performing printing. 

In Fig. 5, job information is input/transmitted as a 



command from a host computer or an instruction from 
a remote controller, or is obtained by analyzing a voice 
command issued by a user using natural language, or 
from bar code or a sentence read from a cover page. 
5 A device that has received the job information ana- 
lyzes the job, and then selects a printer that can execute 
a process suitable for the job and outputs the data to the 
printer Further, when there is an instruction for notifica- 
tion, the device selects an optimal medium and dis- 
10 patches a notice thereto. 

Therefore, upon the receipt of a request from a user 
the structure of the printer is referred to, and an appro- 
priate printer is selected to perform the printing. At this 
time, in consonance with the situation, the processing 
'5 can be allocated for a plurality of printers. Further, when 
there is an instruction for notification, an optimal medium 
is selected to dispatch a notification that the printing has 
been terminated along with the name of the printer that 
has performed the printing. 

A request submitted by a user concerns paper siz- 
es, printing quality, colors and time limit (e.g., comple- 
tion of printing by 5 o'clock). The printer configuration 
covers the printer types and the number of printers in 
the system: and their performances or their current sta- 
tuses (whether the printers are normally operated, 
whether there is a printing queue, or whether paper or 
toner is insufficient). As for a medium and a method 
used for notification, a notification is transmitted by 
voice through a user's terminal or by telephone, or a no- 
tification message is transmitted to a pager, or a docu- 
ment describing the contents of a notification is trans- 
mitted by electronic mail or by facsimile. 

A situation where the individual units perform the 
processing shown in Fig. 5 will now be described while 
referring to the flowchart in Fig. 4. 

First, if, at step 8110, an urgent instruction for out- 
putting a specific document by five o'clock is transmitted 
to a host computer at step 8111 a job is added to a job 
table. At step 8113, the job is extracted from the job table 
and at step 3114 the received instruction is analyzed to 
obtain the object of the job. 

At step 811 5; the following jobs are searched for 
following the analysis of the instruction. 

(1 ) Acquisition of specifications (paper size, printing 
quality, color document, etc.) to be used for select- 
ing a suitable printer for outputting a document, and 
of other information, such as time limit. 

(2) Selection from among the connected printers of 
a suitable printer for specifications (1). 

(3) Examination of the selected printer to determine 
whether or not any obstacle to printing output exists. 

(4) Output data to a selected printer 

(5) Issuance of the selected printer and a notifica- 
tion that the data has been output. 

At step S1 16, the job found at step 8115 is regis- 
tered. The above process is repeated until, at step 8117, 
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there are no jobs to be searched for. At step S118 a 
check is instituted to determine whether or not the job 
can be performed. When the perfornnance of the job is 
not possible, another job that nnust be executed is 
searched for. At S 11 9, the jobs that have been searched 
for are sequentially performed. 

[Second Ennbodiment] 

Fig. 6 is a diagram for explaining an example where- 
in a remote controller (hereinafter referred to merely as 
a controller) is employed as a means for sending Instruc- 
tions to various devices. 

A controller 605, which has a display, displays a 
control panel for, or information concerning a device, 
such as a printer 601 or 602, a facsimile machine 603 
or a PC 604, only by approaching the device, and sends 
Instructions to the device to control it. Further, the con- 
troller 605 can control a remote device across a network 
via the device that is near the controller 605. 

The controller 605 can also monitor and display the 
status of each device, and can acquire the status of a 
remote device on the network via a device that is near 
the controller 605. 

[Third'Embodiment] 

Fig. 7 is a diagram showing an example where a 
document is read by a scanner and is transmitted to a 
specific printer. 

When a document has been read by a scanner 701 , 
a user designates an addressee by voice, etc. , or a des- 
tination transmission is designated on a cover sheet, 
and is thus automatically determined. When a mono- 
chrome printer 702 is determined as an addressee, 

(1) if the addressee is not in the ready for printing 
state, the document data is transmitted to another 
printer (e.g., a monochrome printer 703) for printing; 

(2) if a printer designated as an addressee can not 
print the document because of the conditions spec- 
ified, such as color and paper size, data for only for 
the pertinent page is transmitted to another printer 
(e.g., a color printer 704 if color printing is request- 
ed); 

(3) data for a document having a targe number of 
pages are allocated to a plurality of printers to print; 
or 

(4) If a transfer destination is designated at the ad- 
dressee, the data is transferred to the transfer des- 
tination. 

[Fourth Embodiment] 

Fig. 8 is a diagram showing an example where a 
document is read by a scanner and is transmitted to a 
specific printer that the scanner can not manage be- 
cause It is in a different network domain, etc. 



When, a document is read by a scanner 701 in Aus- 
tin, a user designates an addressee by voice, etc. , or an 
addressee that is described using a character string or 
a bar code on a cover sheet is read and recognized/ 
5 interpreted to determine the addressee. As a result, a 
monochrome printer 702 in Tokyo is determined to be 
the addressee. After the document data are transmitted 
to the monochrome printer 702: 

(1) when the monochrome printer 702 is not ready 
for printing, It transmits the data to another printer 
(a monochrome printer 703) for printing; 

(2) if the monochrome printer 702 is not ready for 
printing the received document data because of 
specified conditions, such as color and paper size, 
it transmits either all the data for the received doc- 
ument or only data for pertinent pages to another 
printer (e.g., a color printer 704, if color printing is 
requested); 

(3) if a document has a large number of pages, the 
monochrome printer 702 prints part of the data and 
also allocates printing data to a plurality of other 
printers; or 

(4) if a transfer destination is designated at the mon- 
ochrome printer 702, the printer 702 transfers the 
data to the transfer destination. 

A difference between the third and the fourth em- 
bodiments is that in the third embodiment the scanner 
701 determines the addressee, and in the fourth embod- 
iment the printer 702 that received the document from 
the scanner 701 determines the transfer destination. 

[Fifth Embodiment] 
• 

Fig. g is a diagram showing an example wherein a 
document is read by a scanner and is transmitted to a 
specific printer that the scanner can not manage be- 
cause it is In a different network domain, etc. 

When, a document is read by a scanner 701 in Aus- 
tin, a user designates an addressee by voice or using a 
keyboard, or an addressee that is described using a 
character string or a bar code on a cover sheet is read 
and recognized/interpreted to determine the addressee. 
As a result, a monochrome printer 702 in Tokyo is de- 
termined as the addressee. After document data are 
transmitted to the monochrome printer 702, they are fur- 
ther transferred to a personal computer 705 that can 
perform a higher level operation. 

As a result, the personal computer 705 determines, 
from the entry "urgent" on the cover letter, for example, 
that the document is an urgent document. The personal 
computer 705 examines schedule data to find the loca- 
tion of the recipient of the document, and transfers the 
data to that location, for example, Atsugi. At this time, if 
the transfer destination is not a printer but is a different 
medium, such as a facsimile machine 706, medium con- 
version is performed before transmission. 
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[Sixth Embodiment] 

Fig. 10 is a diagram showing an example wherein 
a document is read by a scanner and is transmitted to 
a specific printer that the scanner can not manage be- s 
cause it is in a different network domain, etc. 

When, a document is read by a scanner 701 in Aus- 
tin, a user designates an addressee by voice, etc.. or an 
addressee that is described using a character string or 
a bar code on a cover sheet is read and recognized/ fo 
inlerpreted lo determine the addressee. As a result, a 
monochrome printer 702 in Tokyo is determined as the 
addressee. After document data are transmitted to the 
monochrome printer 702, they are further transferred to 
a personal computer 705 that can perform a higher level 
operation. As a result, the personal computer 705 iden- 
tifies the recipient, prepares a notification sentence, and 
notifies the recipient of the arrival of the document. 

[Seventh Embodiment] 

Fig. 11 is a diagram showing an example wherein 
a notification concerning the status of a printer is trans- 
mitted. 

When a PC 1102 acquires the status of a printer 
1 103 across a network and detects a change in the sta- 
tus, such as the occurrence of an error or an event, the 
PC 1102 determines a notification destination, such as 
a user or a manager in consonance with the contents 
of the change, and employs a medium corresponding to 
the determined destination to transmit a notification. For 
example, to transmit a notification to a terminal 1101 of 
a user or a manager, the PC 1102 uses electronic mail, 
or a telephone 1104, or transmits a message to a pager 
1105. 

Therefore, in the example in Fig. 10, for example, a 
notification of the reception of the document may be is- 
sued using electronic mail or a pager, instead of the tel- 
ephone 707. 

[Eighth Embodiment] 

In this embodiment, before executing an instructed 
job an apparatus notifies a user of the contents of the 
job in accordance with the type or the condition of the 
job, or cancels a job that is determined lo be unneces- 
sary for a user. 

Fig. 1 2 Is a flowchart showing the processing in this 
embodiment. Fig. 1 3 is a table showing, in consonance 
with the types and conditions of jobs, whether or not an 
advance notice should be issued. 

In Fig. 12. first, at step 8120 a check is performed 
to determine whether or not a job constitutes necessary 
information for a user. If this is true, the processes at 
step 81 22 and the following steps are performed. If not, 
at step 81 27 the job is canceled. At step 81 22, infomna- 
tion concerning the advance notice that corresponds to 
the job type and conditions in Fig. 13 is referred to, or 



the contents described on a cover sheet are analyzed 
to determine whether or not a notice for the process to 
be executed and the contents of the process should be 
Issued to a user prior to the performance of the instruct- 
ed job. When advance notice is not required, program 
control moves to step 3126. When advance notice is 
issued, program control moves to step SI 24, whereat a 
user is notified of the process to be performed and its 
contents. At step S1 25, the permission for the perform- 
ance is received from a user, if necessary. At step 8126 
the job is performed. 

An explanation will be given for an example where- 
in, when the contents of a job call for the filing of infor- 
mation, an analysis of the system contents is performed 
prior to the filing of information, and information con- 
cerning the contents is transmitted to a user. 

Fig. 14A is a diagram showing an example wherein 
filing process information to be filed is transmitted to a 
user in advance. A file storage unit 1401, a scanner 

1402 and a user terminal 1403 are provided in this sys- 
tem. The processing performed by the scanner 1402 in 
Fig. 1 4A will now be described while referring to the flow- 
chart in Fig. 1 2. 

At step SI 20. since an instructed job is for informa- 
tion filing, it is assumed that this is necessary for a user. 
At step 3122, while information designated In Fig. 13 is 
referred to, it is ascertained that a notice concerning in- 
formation to be filed should be Issued before the filing, 
and that the information should then be scanned. Pro- 
gram control then moves to step 8124 to issue a notice 
concerning information to be filed. At step SI 24 the 
scanned information is transmitted to the user terminal 

1403 via a network. At step 8126, the filing job is per- 
formed. 

Next, an explanation will be given tor an example 
wherein the information on the first page is received and 
analyzed, and when the information Is not at all related 
to a user the following information is not received. 

Fig. 14B is a diagram showing an example wherein 
whether or not a large amount of data to be received is 
required by a user is determined by examining the first 
page, and the receipt of information for the following 
pages is canceled. A reception PC 1404 and a trans- 
mission PC 1405 are provided. 

The processing performed by the PC 1404 in Fig. 
14B will be explained while referring to the flowchart in 
Fig. 12. 

At step 8120, the first page of the received data is 
analyzed. Since "For All Persons In Charge Of General 
Affairs Information" is entered on the first page, it is ap- 
parent that this document is not intended for a user who 
is not in charge of general affairs information, and the 
receipt of the information is determined to be unneces- 
sary. Program control therefore moves to step SI 27. At 
step SI 27, the first page, which has been received, is 
canceled, and information for the second and the follow- 
ing pages is not received. The processing is thereafter 
terminated. 
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[Ninth Embodiment] 

Fig. 15 is a flowchart showing the processing for a 
ninth embodiment. In this embodiment, an apparatus 
that is designated to pGrfonm the processing determines 
whether it or another apparatus should perform the 
processing, and as a result of the determination, either 
performs the processing itself or sends an instruction to 
another apparatus to perform the processing. 

At step S150 a check is perfomned to determine 
whether or not a job has been input. II a job has been 
input, at step SI 51 the input job is entered in a job table. 
At step SI 52 the job table is examined to determine 
whether any jobs have been entered. If they have been, 
at step S153 a job is extracted from the table. At step 
SI 54 a received instruction is analyzed and the object 
of the job is apprehended using the result. At step S155 
the status of the apparatus is examined. At step S156 
the status of another apparatus consonant with the ob- 
ject of the job is examined. 

When, as the result of a comparison of the statues 
of the locally owned apparatus and other apparatuses, 
it is found that the locally owned apparatus is optimal for 
the performance of the job, program control moves from 
step 8157 to step SI 58, whereat it is determined that 
the owned apparatus will perform the job. and at step 

5 1 59 the job is performed by the locally owned appara- 
tus. If there is an optimal apparatus otherthan the locally 
owned apparatus that has capabilities consonant with 
the object of the job. program control goes from step 

51 60 to step 3161. whereat it is determined that the oth- 
er apparatus will perform the job, and at step 8162 the 
locally owned apparatus sends a job execution instruc- 
tion to the apparatus having capabilities consonant with 
the object of the job. At step 8163 the locally owned ap- 
paratus notifies a user that another apparatus has exe- 
cuted the job. 

If there is no apparatus having capabilities conso- 
nant with the object of the job, program control moves 
from step SI 60 to step Si 64, whereat a plan is prepared 
for the use of an optimal method that does not depart 
from the object of the job, and at step SI 65 the plan is 
proposed to a user. 

Fig. 16A is a diagram showing the transmission of 
information in this embodiment. 

When a user of a PC 1 01 provides for a printer 1 04 
a job for the output of information input by a scanner 
102, and when the printer 104 has, for example, a print- 
ing malfunction, the printer ascertains that it can not per- 
form the instructed job, and by communicating with oth- 
er apparatuses, it finds a printer 103 that can perform 
the instructed job. Thus, the printer 104 determines that 
the printer 103 can act for it and perform the job, and so 
instructs the printer 103. Further, the printer 104 trans- 
mits a notification to the PC 1 01 to inform the user of the 
action that it took. In Fig. 16A, the process flow for these 
activities is described by arrows. 

The processes performed by the individual units in 



Fig. 1 6A will be described while referring to the flowchart 
in Fig. 15. 

First, the process performed by the scanner 1 02 will 
be explained. At step SI 50 the scanner 102 scans a 

5 document and acquires a job, information concerning 
which is to be transmitted to the printer 104. At step 
SI 51 this job is entered in the job table, and at step S1 53 
the job is extracted. At step 8154, the scanner 102 
scans additional data and determines that the data is a 

10 job to be transmitted. At step SI 55, the scanner 1 02 as- 
certains that it is operating normally and that no problem 
exists in the scanning and transmission of instructed in- 
formation. 

At step SI 56 it is ascertained that the job can not 
75 be transmitted to another apparatus. At step SI 57, since 
optimally the scanner 102 should execute the job, pro- 
gram control moves to step SI 58. At step SI 58 the 
scanner 1 02 determines that it should scan the informa- 
tion, and at step SI 59 the scanner 1 02 scans the infor- 
mation and transmits it to the printer 104 via a route 1 
on a network. 

At step SI 50, the printer 104 receives the job for 
the output of received information. At step 8151, the 
printer 104 enters the job in the job table, and at step 
SI 53, it extracts it. At step SI 54, the printer 104 ascer- 
tains from the information it receives that the information 
for the user from the PC 101 is to be printed on paper. 
At step 8155 the printer 104 determines that It is out of 
toner and disables printing. At step 81 1 6 the printer 104 
searches, via the network, for printers that can output 
the received information, and finds the printer 103 (route 
2). 

Since, at step 81 57, the printer 1 04 can not execute 
the job, program control moves to step 8160, Then, as 
at step 8160 it is determined that the job for the output 
of information can be performed by the printer 103, at 
step 8161 it is determined that the received information 
should be transmitted to the printer 103. At step SI 62 
the printer 1 04 sends an instruction to the printer 1 03 to 
print the information that is to be received (route 3). At 
step SI 63 to notify the user that the instructed job was 
performed by the printer 103 electronic mail for the user 
is transmitted to the PC 101 (route 4). 

Fig. 16B is a diagram showing the transmission of 
information for a case where no apparatus having ca- 
pabilities consonant with the object of a job is available. 

When the user of the PC 101 provides a job for the 
output to the printer 1 04 of information input by the scan- 
ner 102. and when the printer 104 disables printing be- 
cause it is out of toner, the printer 104 communicates 
with other apparatuses, finds the printer 103, which is 
suitable for the object of the job, and determines its sta- 
tus. Then, since the printer 103 disables printing be- 
cause it is out of paper, and as there is no other printer 
available that Is suitable for the object of the job, a notice 
is issued to the PC 101 to propose to the user an optimal 
plan whereby when either the printer 1 03 or 1 04 has re- 
covered to the printing enabled state, that printer will 
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perform the job. In Fig. 1 6B, the process flow for these 
actions is indicated by arrows. 

The procedures performed by the individual units in 
Fig. 16B will be explained while referring to the flowchart 
in Fig. 15. 5 

The process whereby the scanner 1 02 reads a doc- 
ument and transmits it to the printer 104 is performed in 
the same manner as was described previously. 

At step SI 50 the printer 104 receives a job for the 
output of received information. At step SI 51, the job Is io 
entered in the job table, and at step SI 53, it is extracted. 
At step 8154, the printer 104 ascertains from the Infor- 
mation it receives that the information for the user from 
the PC 101 is to be printed on paper. At step S155, the 
printer 10 ascertains that it is out of toner and printing fs 
is disabled. At step SI 56. the printer 1 04 communicates 
across the network with other printers to find one that 
can print the received information. The printer 104 de- 
termines that the printer 103 has also disabled printing 
because it is out of paper, and that no other appropriate 20 
apparatus is available. 

Since, at step SI 57, the printer 104 disables the 
performance of the job. program control moves to step 
SI 60. At step SI 60, as there is no apparatus that can 
perform the job for the output of Information, program 25 
control goes to step 8164. At step 8164, planning is be- 
gun to prepare an optimal method for performing the 
printing, which is the object of the job for the output of 
information. As a result, it is determined that the optimal 
method involves the return of a printing apparatus to its 3o 
normal operating status. At step SI 65, the proposed 
method, whereby either the printer 104. which is out of 
toner, or the printer 103, which is out of paper, is to be 
recovered to the printing enabled slate, is presented in 
a window shown in Fig. 1 7 for approval by the user. 3S 

Then, a response received from the user, or a 
change in the printer status is Identified as an Input job, 
and the same processing Is again performed. In this 
fashion, the object of the user can be achieved. 

The above described planning will be described lal- 40 
er in detail during the course of the explanation of spe- 
cific examples for an eleventh and subsequent embod- 
iments. 

[Tenth Embodiment] 4S 

In the processing for the ninth embodiment, where- 
in, at steps 8158 and Si 59, a locally owned apparatus 
determines to perform a job itself, and performs the job. 
before another \r\sXrucXe6 job is performed, the possibil- so 
ity of the occurrence of a problem Is analyzed in detail, 
as in the procedures in Fig. 17. When it is ascertained, 
in consonance with environmental condiWons or the sta- 
tus of the job performance, that performing the job is not 
advisable, a notice concerning the problem may be is- ss 
sued, or the request for the performance of the job may 
be rejected. 

When, for example, an instruction for printing a se- 



cret document is issued and a user is not identified as 
an authorized user the instruction Is rejected. 

Fig. 1 8 is a flowchart showing the detailed proce- 
dures tor the performance of a job. 

At step 8180 a check is performed to determine 
whether or not a problem exists concerning the perform- 
ance of the instructed job. At step S181 no problem af- 
fecting the performance of a job is found, at step S185 
the job is performed. If a problem is found, at step SI 82 
a check is performed to determine whether a notice con- 
cerning the problem that was discovered should be 
transmitted to a user, or whether the request for the per- 
formance of the job should be rejected. When it is as- 
certained that such a notice should be transmitted to a 
user at step Si 84 the notice is transmitted to the user 
When it is determined that the request for the perform- 
ance of the job is to be rejected, at step 81 86 the request 
for the performance of the job is rejected and a notice 
of rejection is transmitted to the user 

An example wherein a user of the PC 101 issues 
an instruction to output to the printer 104 confidential 
Information read by the scanner 102 will now be de- 
scribed while referring to Figs. 15 and 18. Fig. 19 is a 
diagram showing example confidential information to be 
read. 

First, at step SI 50 the scanner 1 02 scans available 
information and receives a job for the transmission of 
information to the printer 104. At step SI 51 the job Is 
entered in the job table, and at step SI 53, the job is ex- 
tracted therefrom. At step SI 54 data are scanned, and 
it is ascertained the data constitute a job to be transmit- 
ted. At step 8155, the scanner 102 determines that it is 
operating normally and that there is no problem affecting 
the scanning and transmission of the instructed Infor- 
mation. 

At step S 155 it is ascertained that the job can not 
be transmitted to another apparatus. Since, at step 
8157, it is ascertained that optimally the scanner 102 
should perform the job itself, program control moves to 
step 8158, whereat the scanner 102 determines that it 
should scan the information itself. 

At step SI 80, as a result of the scanning of the in- 
formation, it is determined to be confidential information 
whose output is inhibited. Since a problem affecting the 
performance of the job exists, at step 8182 it is deter- 
mined that the job (the scanning and the outpultlng of 
information) should be rejected. At step S183 the job is 
rejected, and program control thereafter goes to step 
SI 86. At step SI 86, a notice is issued that the job was 
rejected. 

Similarly, when a plurality of users employ the same 
system, the current user can be identified by a log-in 
name, and an instruction for the output of the contents 
of files belonging to other users can be rejected. When, 
instead of an instruction from a user, a document is re- 
ceived from the outside and the destination user differs 
from the current user, the output of the received docu- 
ment and the notice of the receipt of the document are 



15 



29 



EP 0 851 384 A2 



30 



rejected, or the processing is halted until the destination 
user begins to employ the system. 

[Eleventh Embodiment] 

5 

The processing for an eleventh embodiment will 
now be described while referring to Fig. 4. At step SI 09 
the job table is initialized. Then, at step S11 0 a check is 
performed to determine whether there is input from a 
user or from an apparatus that can be detected by the io 
system. At step S1 11 an input analysis job is entered in 
the job table to analyze the contents input at step S11 0. 
At step S11 2 a check is performed to determine whether 
there is a job to be performed. If there is such a job, it 
can be acquired at step 811 3. At step S11 4, the object i5 
comprising the background lor the performance of the 
job Is understood. 

At step S11 5 a possible process is planned by using 
the contents that are input, the status of a device that 
can be detected by the system, and the knowledge that 
the system has currently acquired. At step S116 a new 
job is added if necessary. At steps S117 to S119 the 
process as planned at step S115 is performed in conso- 
nance with the contents. The processing Is repeated un- 
til no more jobs remain, and program control thereafter 2S 
returns to step S110. 

A case where a user is to print <file A> will now be 
explained. Fig. 23 is a diagram showing the contents of 
<file A>. the colored picture of a car. Fig. 1 is a diagram 
showing the structure of the system in this embodiment. 30 
A user sends an instruction from a PC 101, and a mon- 
ochrome printer 104 is set as a normally used printer. A 
color printer 103 Is also set. 

At step SI 09 the job table is initialized. At step 8111 
a job that is to be performed when there is no input is 3S 
added to the job table (Fig. 20). When file name <file A> 
Is designated in a window In Fig. 21 and printing for It Is 
selected, at step S1 1 0 it is determined that there is input, 
and program control advances to step 5111. At step 
8111, as is shown in Fig. 22, an input analysis job is 40 
entered in the job table. Since, at step S1 12. there is a 
job to be executed, program control advances to step 
S1 13. At step S1 13 an analysis of the job to be per- 
formed (input "print <file A>") is acquired. At step S114 
it is ascertained that the object of the input "print <file 45 
A>- is the printing of the <file A>. 

At step S1 15 planning is performed, based on the 
following conditions and statuses, for proposing, to a us- 
er that the printing be performed by a color printer. * <file 
A> Includes a colored portion (the portion comprising 50 
the car In Fig. 23) 

* the color printer 103 that can be used is present (Fig. 
1). 

At step S119 a query "Perform printing by a color 
printer?" is directed to a user (Fig. 24). At the same time, 55 
a job corresponding to an event is added to the job table 
when no response is received from the user (Fig. 25). 
Program control thereafter returns to step S1 1 0. 



When, at step S1 10, there is no input for ten min- 
utes, at step S1 1 2 it Is assumed that there is a job to be 
performed, and program control advances to step S1 1 3. 
At step S1 13, a job to be performed (when no response 
Is received from a user) is acquired. 

At step S1 14 It is ascertained that the object for a 
job when there is no response from a user is to deter- 
mine whether a proposal can be accepted. At step S115 
it is determined from the flow condition and the status 
that the user should be queried by telephone. 

* The telephone number of the current location of the 
user is acquired (schedule data in Fig. 26) 

* The printing priority is urgent (according to the 
schedule data In Fig. 26, file A is to be used at the 
business talk at 1 3:00). 

At step S1 1 9 a query, "Perform printing with a color 
printer?" Is directed to the user (Fig. 27). At the same 
time, a job corresponding to an event is added to the job 
table when no response is received from the user (Fig. 
28). Program control thereafter returns to step S11 0. 

When, at step S1 10, a user responds with "Yes, 
please" as is shown in Fig. 27, it is assumed that data 
Input Is to be performed, and program control moves to 
step S111. At step S111 an input analysis job is added 
to the job table (Fig. 21 ). At step S112 it is assumed that 
there is a job to be performed, and program control 
moves to step S 1 1 3. At step 81 1 3, a job to be performed, 
the input, "Yes, please" is analyzed. At step S1 14 It is 
ascertained that the object of the input, "Yes, please" Is 
the acceptance of the proposal. 

At step S115 it is determined that <file A> is to be 
transmitted to and printed by the color printer 103. At 
step S1 18 <file A> is transmitted to and printed by the 
color printer 103. At the same time, a job for confirming 
whether or not the printing has been terminated normal- 
ly is added to the job table (Fig. 29). Program control 
thereafter returns to step S110. 

If, at step 8110 there is no data input and at step 
S1 12, as is shown in Fig. 30, the printer status is 
changed from "Printing" to "Printed document in tray" it 
is assumed that there Is a job to be executed, and pro- 
gram control advances to step S113. At step S113 a 
process corresponding to the job to be executed, printer 
status, is acquired. At step S1 14, from a printer status 
entry in Fig. 31, the status "Printed document in tray" 
means that there is a printed document in a printer tray, 
and the object of the job Is understood to be the delivery, 
of the printed document to a user. 

At step S1 15, a waiting state is specified because 
the user may soon come to pick up the printed docu- 
ment. At step SI 16, a job for confirming whether the user 
has come and has picked up the printed document is 
added to the job table (Fig. 32). Program control there- 
after returns to step S1 10. If, at step S1 10, there is no 
input for ten minutes and at step S112 the printed doc- 
ument is still on tray, there is a job to be executed, and 
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program control therefore advances to step S113. At 
step S113 a process corresponding to the job to be ex- 
ecuted, when the printed document is still on hand, is 
acquired. At step S114, from the table in Fig. 31 the sta- 
tus "Printed document on tray" means that a printed doc- 5 
ument Is still in the printer tray, and it is assumed that 
the object is the delivery of the printed document to the 
user. Since at step S1 15 the printed document has not 
been picked up for ten minutes, it Is assumed that the 
user has forgotten to collect the document, and it Is de- io 
termlned that a notice, "Printed document Is in color 
printer tray" is to be issued (Fig. 33). Also, a job corre- 
sponding to the failure of the user to respond and a job 
corresponding to the collection of the printed document 
by the user are added to the job table (Fig. 34). Program is 
control thereafter returns to step 8110. 

When at step S1 10 there Is no Input and at step 
8112 the printer status Is changed from "Printed docu- 
ment in tray" to "Normal" as is shown in Fig. 28, there 
is a job to be executed and program control advances 
to step S1 13. At step 8113 a job corresponding to the 
job to be executed, printed document in tray, Is re-eval- 
uated. At step S1 1 4 the object for the rechecking of the 
job corresponding to the "Printed document in tray" is 
understood to be the deletion of an unnecessary job. At 2S 
step 8115, it is determined that the job of waiting for a 
response from the user should be deleted, and at step 
S1 19 the job of waiting for the user's response is delet- 
ed. A new job is not added. While the job table is in its 
initial state, program control returns to step S110. 30 

Figs. 36 and 37 are tables showing plans, actions 
and rules. 

When a user presses the button "Print" in the print- 
ing window In Fig. 21 .. it Is determined by referring to the 
plans and actions in Fig. 36 that the object of the user 3S 
is the changing of the current state to the "Printed doc- 
ument In tray". In addition, since "Printed document in 
tray" Is the assumption for the object "Acquire printed 
document" the final object ot the user is determined to 
be "Acquire printed document". 40 

When a user expresses agreement or disagree- 
ment by voice or by the manipulation of the mouse In 
response to the query in the inquiry window in Fig. 24 
or the window in Fig. 33, or the telephone query in Fig. 
27, it Is determined that the object of the user is the state- 4S 
ment of the agreement or disagreement relative to the 
query. 

In Fig. 37 the final object of the system is the thus 
constitutes the achievement of the object of the user. As 
the basis for this, the system must be stable. In addition, so 
the system must (1 ) apprehend the object of the user 
and (2) must make a plan for the achievement of the 
object and execute it. 

To stabilize the system, not only an abnormal timing 
for the system must be adjusted to the normal condition, 55 
but also the system must be powered off when it is not 
required in order to reduce costs and to prevent the sys- 
tem from becoming unstable. 



Fig. 38 is a diagram that for easier understanding 
shows only one part of the table in Fig. 37. 

In order to understand the object of the user, data 
that is Input is Identified. Further, corresponding to "ac- 
quire printed document" which is the object of the user 
in Fig. 36, "Transfer printed document to user" which is 
the object of the system. 

The presence of a printed document Is the premise 
for the transfer of the printed document to a user, and 
the object Is achieved by notifying the user of the loca- 
tion of the document. Of course, the user must collect 
the document or the document must be delivered to the 
user by some means In order for the user to acquire the 
document; in this embodiment, it is determined that 
when the printed document is no longer In the printer 
tray, that is the equivalent of the user having acquired 
the document. 

The presence of an original document and the print- 
ing conditions are required in order to obtain a printed 
document, and It is premised that a corresponding print- 
ing environment normally exists. In this situation, a cor- 
responding printing environment is selected to perform 
printing. The original document must be so prepared 
that its existence is constant. In addition, to clarify the 
printing conditions, only when there is a question con- 
cerning a condition need ask a user queries. When a 
printing environment is abnormal, the printing environ- 
ment Is normalized to maintain normal environment. 
When no response Is received from a user within a pre- 
determined period of time, additional planning must be 
performed to ascertain the Intent of the user. 

The properties of each device are stored in a mem- 
ory in each device, or in the memory of the server that 
manages each device. Fig. 39 Is a table showing the 
properties of the devices. The statuses of the devices 
are held In the devices, and are voluntarily transmitted 
to other apparatuses by the devices, or by the passive 
transfer of them when requested by another server 

In this system, the properties are inherent to the in- 
dividual devices and do not change; they are acquired 
when the system is activated or when a connection 
across the network is altered. In the planning process, 
the statuses are acquired, as needed, or at a specific 
time Interval, and are updated as information intended 
for the internal memory. 

[Twelfth Embodiment] 

An explanation will now be given for the processing 
performed in a case where, as in the eleventh embodi- 
ment, a color printer is busy when <file A> is to be print- 
ed. 

First, when "Print <file A>" Is input, it Is entered In 
the job table, and Its object is understood to be a request 
that printing be performed. Assume as the condition/sit- 
uation that the colored portion is Included In a document 
and a color printer is busy; A plan is devised to query a 
user concerning whether the job can wait until the color 
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printer is not busy, or whether the data can be printed 
in monochrome. The query, "The color printer is busy. 
Wait, or print in monochrome?" is presented to a user. 
When the user selects "Wait" the process is placed on 
standby until the color printer is no longer busy. s 

[Thirteenth Embodiment] 

When "<file A> was changed to <flle A'>" Is Input, it 
Is ascertained that the updating of the job table Is the 
object. As the condition/situation, the <flle A> printing 
job is stored in the job table. Thus, a plan is made to 
query a user concerning the changing of the printing tar- 
get to <file A'>. Then, the query "Print <flle A'> instead 
of <file A> before amended?" is presented to the user. 

[Fourteenth Embodiment] 

According to this embodiment, in a system wherein 
a plurality of apparatuses are connected together (in this 
case, they are connected across a network), when a job 
for an individual apparatus is instructed, an analysis of 
the object of the job is performed by the appearance. 
When the apparatuses determine from their statuses 
and the status of the instructed apparatus, that the in- 
structed apparatus should not execute the job, the per- 
formance of the job is transferred to another apparatus. 

Figs. 41 A and 41 B are diagrams in each of which 
Is shown the condition where a plurality of apparatus are 
connected to a network. A network In Fig. 41 A provides 
an environment wherein a scanner 41 1 and printers 41 2 
and 413 can determine the states of the other appara- 
tuses. A network in Fig. 41 B provides an environment 
wherein the scanner 411 and the printers 412 and 413 
can not determine the states of the other apparatuses. 

Fig. 42 is a diagram illustrating a functional arrange- 
ment for performing the processing in this embodiment. 
A job reception unit 421 receives a job from a user or 
from another apparatus. A received job is registered in 
a job table 422. A job analysis unit 423 extracts the job 
from the job table 422 and analyzes It. Another appara- 
tus Information acquisition unit 424 determines the at- 
tributes and the current statuses of other connected ap- 
paratuses. A self state determination unit 427 deter- 
mines the attribute and the current state of the self ap- 
paratus. 

An optimum planning unit 425 prepares an optimal 
plan for the performance of a job. A job performance 
determination unit 428 determines whether or not a job 
is to be performed, and whether the locally owned ap- 
paratus or another apparatus should perform the job. 
When the job is to be performed by the locally owned 
apparatus, a job performance unit 426 performs it. 
When another apparatus is to perform the job, another 
apparatus job transfer unit 429 transfers the job to an- 
other apparatus. A transfer notification unit 430 notifies 
a user of the results obtained by the job performance or 
the transfer of the job to another apparatus. Fig. 43 is a 



main flowchart showing the processing performed for 
this embodiment. 

At step S430, In order to determine whether a job 
has been input, a check is performed to determine 
whether or not a job has been input by a user, a job has 
been input by a device that can be detected by a system, 
based on the results obtained by analyzation of the jobs, 
or a new job that has been generated by the locally 
owned apparatus while idling. When a job has been In- 
put, at step S431 , an input job Is added to the job table. 
At step S432, the job table is examined to determine 
whether there is a job. If there is a job, at step S433 the 
job is extracted. At step S434 a received instruction is 
analyzed, and from the Information attained by the an- 
alyzation, the object of the job Is obtained. At step S435 
a check Is performed to determine whether or not a job 
for another apparatus is present. If there is such a job, 
at step S436 control of another apparatus is initiated. If 
there is no such job, at step S437 a control process the 
locally owned apparatus is Initiated. 

Fig. 44 is a flowchart for the process for controlling 
another apparatus performed at step S436 In the main 
flowchart. 

At step S440 the status of an apparatus that is des- 
ignated in the job is examined, and at step S441 , based 
on the status, a check is performed to determine wheth- 
er a problem affecting the performance of the job by the 
designated apparatus exists. If no such problem exists, 
at step S442 the job is transmitted to the designated ap- 
paratus. If a problem affecting the performance of the 
job by the designated apparatus exists, at step S443 a 
check is performed to determine whether or not there is 
an apparatus other than the designated apparatus that 
is suitable for the performance of the job. If there Is such 
an apparatus, its status Is examined. As a result, if there 
is another apparatus that can execute the job, at step 

5445 the job is transferred to that apparatus, and at step 

5446 the user is notified of that the job was transferred 
to that apparatus. When there is no apparatus other than 
the designated apparatus that can perform the job, or 
when another suitable apparatus can not be used at that 
time, at step S447 an optimal plan is devised that will 
not degrade the object of the job, and at step S448, the 
plan Is proposed to the user. 

Fig. 45 is a flowchart for the process for controlling 
the locally owned apparatus performed at step S437 in 
the main flowchart. 

At step S450 the status of the locally owned appa- 
ratus is examined, and at step S451 , based on the sta- 
tus, a check is performed to determine whether a prob- 
lem affecting the performance of the job by the locally 
owned apparatus exists. If no such problem exists, at 
step S452 the job is performed by the locally owned ap- 
paratus. If a problem affecting the performance of the 
job by the locally owned apparatus exits, at step S453 
a check Is performed to determine whether or not there 
is an apparatus other than the locally owned apparatus 
that is suitable for the performance of the job. If there is 



IS 



20 



25 



30 



35 



40 



45 



50 



18 



35 



EP 0 851 384 A2 



36 



such an apparatus, its status is examined. As a result, 
if there is another apparatus that can execute the job, 
at step S455 the job is transferred to that apparatus, and 
at step S456 the user is notified that the job was trans- 
ferred to thai apparatus. When there Is no apparatus 
other than the locally owned apparatus that can perform 
the job, or when another suitable apparatus can not be 
used at that time, at step S457 an optimal plan is devised 
that will not degrade the object of the job, and at step 
S458, the plan is proposed to the user. 

Fig. 46 is a diagram showing the condition that ex- 
ists when, while, in Fig. 41 A, an instruction is issued to 
output to the printer 412 along route A information that 
has been read by the scanner 41 1 , the other apparatus 
information acquisition unit 424 of the scanner 411 dis- 
covers a malfunction at the printer 412, and this Infor- 
mation is output to the printer 41 3 along route B. 

Fig. 47 is a diagram showing the condition that ex- 
ists when, while, in Fig. 41 B, the scanner 41 1 is instruct- 
ed to output the information that is read to the printer 
41 2 along route A and to confirm the status of the printer 
412, since the printer 412 is located In a remote area, 
the scanner 41 1 takes the status of the network Into ac- 
count and unconditionally transmits the information to 
the printer 412, which then, because a malfunction has 
occurred there, transfers the received information (job) 
to the printer 413. 

The processing performed In Figs. 46 and 47 will be 
described while referring to the flowcharts shown In 
Figs. 43 to 45. 

When In Fig. 46 a job is to be output by the scanner 
41 1 and transferred to the printer 41 2, the scanner 41 1 
performs the following process. 

First, at step S430 the scanner 411 receives a job 
for the scanning of information and the transmission of 
it to the printer 412. At step S431 the job is entered in 
the job table, and at step S433, it is extracted therefrom. 
At step S434 the scanner 411 scans the data and as- 
certains the job involves the transmission of data to a 
designated printer. At step S435 it is determined that 
there is a job, which is to be executed by another appa- 
ratus, for the output of the scanned information by the 
printer 412. Based on this determination: at step S436 
program control moves to another apparatus control 
process in Fig. 44. 

At step S440 the current state of the printer 412 is 
acquired. Then, information that the printer 41 2 has mal- 
functioned is received, and at step S441 it is determined 
that printing by the printer 412 is disabled. In this case, 
besides a malfunction, the printer 41 2 can also be in an 
out of paper or out of toner disabled state. At step S443, 
it is assumed that the designated printer 412 can not 
execute the job, and another apparatus that can execute 
the job is searched for by communicating with the other 
apparatuses across the network. At step S444 it is found 
that the printer 41 3 can execute the job and the perform- 
ance of the job is assigned to it. 

At step S445 the scanned information is transmitted 



to the printer 413. And at step S446, since a process 
other than the one instructed is being performed, the us- 
er is notified of the job alteration. Since the process for 
the instructed job has been terminated, the system waits 

5 for the next job. 

Following this, a process in Fig. 47 where a job is 
to be output by the scanner 41 1 and transmitted to the 
printer 412 will now be explained. 

First, at step S430 the scanner 41 1 receives a job 

10 for the scanning of information and the transmission of 
the information to the printer 412. At step S431 the job 
is entered in the job table, and at step S433, it is extract- 
ed therefrom. At step S434 the scanner 411 scans the 
data and ascertains the job is for the transmission of 

^5 data to a designated printer. At step S435 it is deter- 
mined that there is a job. which is to be executed by 
another apparatus, for the output of the scanned infor- 
mation by the printer 412. Based on this determination, 
at step S436 program control moves to another appa- 

20 ratus control process in Fig. 44. 

At steps 440, while the scanner 411 communicates 
with the printer 412 and attempts to acquire its status, 
it is found that the printer 412 is In a remote area and 
the scanner 41 1 decides to transmit the information, re- 

25 gardless of the status of the printer 412. At step S441 it 
is determined that there is no problem with the printer 

412 since it is in a remote area, and at step S442 the 
scanned information is transmitted to the printer 412, 
which is the designated apparatus, and the job Is trans- 

30 ferred thereto. Since the instructed job has been termi- 
nated, the scanner 411 waits for the next job. 

At step S430 the printer 41 2 receives the job for out- 
putting the received information. At step S431 the job is 
entered in the job table, and at step S433, it is extracted 

35 therefrom. At step S434the printer 41 2 understands that 
the job is for the printer 41 2 to output the received infor- 
mation. At step S435 It is detenmined that there Is no job 
for another apparatus, and at step S437 program control 
moves to an own apparatus control process in Fig. 45. 

40 At Step S450 the current state of the printer 412 is 

examined, and at step 8451 the printer 412 judges by 
itself that the printer 412 has a malfunction and is in a 
printing disabled state. In this case, besides the mal- 
function, the printer 412 can be in such an output disa- 

45 bled state as out of paper or out of toner. At step 8453, 
another apparatus that can execute the job is searched 
for by communication with the other apparatuses across 
the network. 

At step S454 the printer 41 3 lhat can execute the 
50 job is found, and the execution of the job at the printer 

413 is determined. At step S455, the printer 412 trans- 
mits the received information to the printer 41 3. At step 
8456, since the process other than being instructed is 
performed, the user is notified of the alteration of the 

55 job. In this embodiment, such a notice is issued to the 
instruction source user. Since the output destination is 
far away from the instruction source, the notice may be 
issued to a recipient Since the instructed job has been 
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terminated, the system waits for the next job. As at the 
printer 41 3there is no processing problem and the print- 
er 41 3 can perform the job for the output of the received 
information, the printer 41 3 performs the job. 

In the above embodiment, the individual units auto- 
maticalfy transfer the job. If there Is a problem at each 
apparatus, a user may provide a transmission order for 
the transfer of the job by the apparatuses. In this em- 
bodiment, a user inputs as a job the employment of a 
designated printer to print a scanned document; how- 
ever, a second and a third printer may at the same lime 
be set for the job, so that if the designated printer mal- 
functions they can replace it and perform the printing. 
Th us, at step S443 or S453, the second or the thi rd print- 
er can be selected as a suitable apparatus for the job 
and its status is examined. A second or a third printer 
may be set as a printer to receive a job and to replace 
a designated printer when it is in a printing disabled 
state. However, even when a second or the third printer 
is not set for the job. the printer that receives the job can 
transfer it in consonance with destinations that are set 
internally. 

In addition to a malfunction and an operation disa- 
bled state, the following conditions can cause the per- 
formance of a job to be canceled: the specifications may 
be inappropriate for the performance of the job, e.g., a 
case where a job for the printing of color data is issued 
to a monochrome printer; or immediate processing of 
the job may not be possible because there are too many 
jobs in a queue. 

[Fifteenth Embodiment] 

In this embodiment, in a process for determining the 
status of the locally owned apparatus at step S450 in 
Fig. 45, schedule information for a user, which is the ob- 
ject, is examined as a factor that is used to determine 
whether a problem exists that will affect the performance 
of a job involving the output to a user of urgent informa- 
tion received by a printer. 

An explanation will be given for a process that is to 
be performed In the environment shown in Fig. 48, 
where a user, to whom urgent information is to be trans- 
mitted, is currently at an outside location at which a print- 
er 412 is available that is connected to a network. 

In the procedures in Fig. 43, at step S434 it is as- 
certained that the object of the job is the transmission 
to a user of urgent information that has been received. 
At step S435, since at this time there is no job for another 
apparatus, program control moves to step S437. At step 
S437 the process advances to the locally owned appa- 
ratus control process in Fig. 45. 

At step S450, in order to determine the status of the 
locally owned apparatus, the schedule of a user who is 
designated as a transmission source is confirmed by the 
PC 414, and it is ascertained that the user is at an out- 
side location. Since the user is at an outside location, at 
step S451 it is determined that a problem related to mak- 



ing urgent contact exists at the locally owned apparatus. 
At step S453 a check is performed to determine whether 
or not a printer that can output information is present at 
the user's destination. At step S454 it is confirmed that 
5 there is a printer 41 2 that can output information, and it 
is determined that the printer 41 2 will be used to output 
the information. At step S455 the information is trans- 
mitted to the printer 412. At step S456 the users at the 
transmission source and at the reception destination are 
notified that the job has been transferred. 

When, at step S443, there is no printer available to 
which to transfer the job but there is another apparatus 
that can be employed by the user, such as a PC, a fac- 
simile machine or a telephone, at step S444 it may be 
determined to perform the job by using one of the avail- 
able apparatuses. Since the information can not be 
transmitted unchanged, at step S445 the information to 
be output to the printer is converted into an electronic 
mail document or a facsimile document, or Is changed 
to voice information for the output. 

At step S446, depending on the medium used for 
the output, a notice that the job was transferred to an- 
other medium need not be issued, and can be transmit- 
ted by using the same medium. For example, when a 
telephone is used to transmit the information, it is better 
to notify a user of the job transfer before or after the 
transmission of the information. 

instead of the telephone, at step S443, the above 
PC: the facsimile machine or the telephone may be de- 
termined to be a suitable apparatus to replace the printer 
for the job. At step S447 the employment of such an ap- 
paratus may be determined to be an optimal plan that 
does not degrade the object of the job, and at step S448 
the plan may be proposed to a user. 

[Sixteenth Embodiment] 

Fig. 49 is a flowchart showing the processing for this 
embodiment. Steps S498 to 8500 are additionally pro- 
vided for the flowchart in Fig. 43 as a process to be per- 
formed when there is no job. At step 8498 the current 
operating statuses of other apparatuses are examined, 
and at step S499 a check is performed to determine 
whether or not a job that the locally owned apparatus 
can perform is being held in another apparatus and not 
being performed. II such a job is being held in another 
apparatus, at step S500 the job is extracted from the 
pertinent apparatus and is entered in the job table for 
the locally owned apparatus, while it is deleted from the 
job table for the pertinent apparatus. In this embodi- 
ment, therefore, an apparatus finds a job by itself and 
processes it. 

Fig. 50 is a conceptual diagram showing the situa- 
tion for this processing. Since no job is present in a print- 
er 41 2. and a printer 413 has ten jobs in a queue, a print- 
er 41 5 acquires a job from the printer 41 3 and processes 
it. 

The process performed by the printer 415 is as fol- 
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lows. At step S492 there is no job, and program control 
moves to step S498. At step S498 the current statuses 
of the other printers, 41 2 and 41 3, are examined. At step 
S499 it is determined that at the printer 413 there is a 
job that the printer 415 can execute. At step S500 the 
printer 415 extracts that job from the printer 413, and 
enters it in its job table. Then, the extracted job is deleted 
from the job table for the printer 41 3. Since at step S490 
there is no job input, and at step S492 there Is a job that 
was entered previously, program control moves to step 
S493 to execute the job. 

The operations for the performance of the job by the 
locally owned apparatus, which were explained in the 
fourteenth and the fifteenth embodiments, are per- 
formed, and the processing is thereafter terminated. 

[Seventeenth Embodiment] 

Fig. 51 is a diagram showing the transmission in this 
embodiment of a print job and other information in a sys- 
tem employing apparatuses. The heavy arrows are 
used to depict the transmission routes for the print jobs, 
and the broken line arrows are sued to depict the trans- 
mission routes for other information. 

The print job in this embodiment includes parame- 
ters that are referred to during printing: the document to 
be printed; the number of print copies; the print quality; 
and the print size. The other information includes the 
statuses, such as printing, normal, or out of paper, of 
individual printers, and a schedule for a print job proc- 
essed by a print job scheduling unit. 

In Fig. 51 , in a client machine 510, a print job gen- 
eration unit 512 generates a print job, and stores it in a 
print job memory unit 51 3. Then, the print job is trans- 
mitted by a print job transmission unit 514 In the client 
machine 510 to a server machine 511 for managing 
printers. 

In the server machine 511, a print job reception unit 
516 receives the print job. When the parameters of the 
print job have not yet been set, the print job is transmit- 
ted to a print job automatic setup unit 517, and when the 
parameters have already been set, the print job is trans- 
mitted to a print job automatic change unit 518. 

The print job automatic setup unit 517 sets print pa- 
rameters while taking into consideration the urgency, 
economy and the quality that are acquired by the print 
job. The print job automatic change unit 5 1 8 can perform 
the same process for changing parameters that have 
previously been set. The print jobs that are set or altered 
are registered in a print job schedule included in a print 
job scheduling unit 520 and are sequentially read to a 
print job transmission unit 519, or the print job may be 
directly transmitted to the printer job transmission on the 
unit 519 from the print job automatic setup unit 517 or 
the print job automatic change unit 518. The printing is 
then performed. 

The status, such as in printing, normal or out of pa- 
per, of an available printer is acquired by a printer state 



acknowledgement unit 515. and is transmitted to the 
print job automatic setup unit 517 and the print job au- 
tomatic change unit 51 8 where it is employed for the set- 
up or change of the print job. Similarly, the printing 
5 schedule for the print job included in the print job sched- 
uling unit 520 is also transmitted to these units 51 7 and 
518 for their employment. 

As is shown in Fig. 51 , a print job may be transmitted 
along a different route. When a machine for generating 
10 a print job is the same as a machine for managing print- 
ers, the print job may not be transmitted via the print job 
transmission unit 514. 

Fig. 52 is a flowchart showing the processing per- 
formed by the print job automatic setup unit 517. The 
print job automatic setup unit 517 automatically sets pa- 
rameters within a range that satisfies a designated qual- 
ity and the printing can be performed as rapidly and as 
economically as possible. 

In Fig. 52, at step 8520 a factor for determining the 
printing lime and the amount of consumed toner is ini- 
tialized in preparing for the simulation. Then, at step 
8521 a quality determination variable Is initialized to a 
maximum quality value (e.g., 5), and at step S522 the 
period of time for the printing is simulated. At step S523 
a check is performed to determine whether the simulat- 
ed period of time for the printing equals a specified val- 
ue. When the time period for the printing equals a spec- 
ified value, at step S524the consumption of toner Is sim- 
ulated. At step S525 a check is performed to determine 
whether the simulated consumption of toner equals a 
specified value. When the consumption of toner equals 
a specified value, the job is changed to the current qual- 
ity determination variable value at step S526. 

When, at step S523 or S525, the period of time for 
the printing or the consumption of toner Is not equivalent 
to its specified value, at step S527 the quality determi- 
nation variable is decremented by one. At step S528 a 
check is performed to determine whether or not the re- 
sultant quality determination variable satisfies is equiv- 
alent to a designated quality. When the designated qual- 
ity is satisfied, program control returns to step S522. 
When the designated quality is not satisfied, the 
processing is terminated with an automatic setup disa- 
bled state. 

Fig. 53 is a table showing the period of time for the 
printing and the consumption of toner for one character 
corresponding to different specified qualities for the 
printers A52 1 and B522. These values may be fixed val- 
ues inherent to individual printers, or may be dynamic 
variable values, which are averages obtained for print- 
ing periods or for consumption of toner that were meas- 
ured in the past. 

Fig. 54 is a diagram showing the contents of a print 
job that Is to be output in this embodiment, and param- 
eters that were designated by a user. In the system for 
the embodiment: the contents of a print job in Fig. 54 
and the set-up parameters are collectively called a print 
job. In this embodiment, calculated in terms of charac- 
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ters, 500 characters are employed as the printing quan- 
tity for the print job in order to sinnulate the period of time 
for the printing and the consumption of toner. In addition, 
it is assunned that for urgency a user will designate a 
period of only one minute, and will keep the default val- s 
ues for economy and quality. 

In the example shown in Fig. 54, when the print job 
automatic setup unit 517 is activated, at step S520 in 
preparing of simulation, a factor for determining the pe- 
riod of time for the printing and the consumption of toner io 
Is initialized. As defined in the table in Fig. 53, for exam- 
ple, the periods of time required for the printing of one 
minimum quality (= 1 ) character by the printer A521 and 
the printer B522 are, on average, 100 mS and 200 mS 
respectively, and the consumption of toner for one char- is 
acter are 1 00 mg and 200 mg. 

Following this, at step S521 the quality determina- 
tion variable Is Initialized to the maximum quality value 
(e.g., 5), and at step S522 the printing period of time for 
the printing is simulated. If, for example, the printers 20 
A521 and B522 are prepared for printing and no print 
job is scheduled in the print job scheduling unit 520, 
printing can be Initiated Immediately, and no waiting time 
is required. Thus, when the target print job includes 500 
characters, as simulation, printer A takes 250 seconds 25 
to print the characters and printer B takes 500 seconds. 

Then, at step S523 it is determined that this condi- 
tion does not satisfy the one minute urgency period that 
is specified by the parameter in Fig. 54, and at step S527 
the quality determination variable value is decremented 30 
by one. 

Since the quality is not specified in the parameter 
in Fig. 54, program control returns to step S522 for sim- 
ulation of the period of time for the printing. When, as 
the result of the repetition of the above process, the 3S 
quality is set to the minimum quality of 1, the period of 
time for the printing by the printer A521 Is 50 seconds, 
which satisfies the urgent figure. Therefore, the quality 
is set to the minimum quality determination variable val- 
ue (= 1), and the processing is normally terminated. 40 

If the quality is set to 2 or higher, it does not meet 
the parameters set by the user, and the processing is 
terminated as an automatic setup disable error. 

[Eighteenth Embodiment] 45 

Fig. 55 is a flowchart showing the processing per- 
formed by a print job automatic change unit 518. The 
print job automatic change unit 518 automatically 
changes a parameter within a range that satisfies a so 
specified urgency and economy so as to print data hav- 
ing as high a quality as possible. When all the specified 
parameters can not be satisfied, the most important des- 
ignated parameter is satisfied and the others are 
changed as slightly as possible. ss 

Fig. 56 is a diagram showing the contents of a print 
job that Is to be output in this embodiment, and param- 
eters designated by a user. In the system of the embod- 



iment, the contents of a print job in Fig. 56 and the set- 
up parameters are collectively called a print job. In this 
embodiment, calculated in terms of characters. 500 
characters are employed as the printing quantity for the 
print job in order to simulate the period of time for the 
printing and the consumption of toner In addition, it is 
assumed that a user designates all of the paramsters 
and particularly specifies that the quality is the most im- 
portant. 

In the example shown in Fig. 55, when the print job 
automatic change unit 51 8 is activated, at step S520 in 
preparing for the simulation, a factor for determining the 
period of time for the printing and the consumption of 
toner is initialized. As is defined in the table in Fig. 53, 
for example, the period of time required for the printing 
of one minimum quality (= 1) character by the printer 
A521 and the printer B522 are, on average, 1 00 mS and 
200 mS respectively, and the consuniption of toner for 
one character are 100 mg and 200 mg. 

Following this, at step S551 the quality determina- 
tion variable is initialized to the maximum quality value 
(e.g., 5), and at step S552 the period of time for the print- 
ing is simulated. If, for example, the printers A521 and 
B522 are prepared for printing and no print job is sched- 
uled in the print job scheduling unit 520, printing can be 
initiated immediately, and no waiting time is required. 
Thus, when the target print job includes 500 characters, 
as simulation, printer A takes 250 seconds to print the 
characters and printer B takes 500 seconds. 

Then, at step S553 It is determined that this condi- 
tion does not satisfy the one minute urgency period that 
is specified by the parameter in Fig. 56, and at step S556 
the quality determination variable value is decremented 
by one. 

Since, at step S557, the quality in the parameter in 
Fig. 56 is not satisfied, program control returns to step 
S552 for simulation of the period of time tor the printing. 
As a result of the repetition of the above process, even 
when the quality Is the one (= 3) designated by the user 
the urgency period can not be satisfied. When, at step 
S556, the quality determination variable value is decre- 
mented by one, at step 8557 the quality specified by the 
user is still not satisfied, and program control therefore 
moves to step 8558. At step S558 a check is performed 
to determine whether the quality is the most important 
parameter. When the quality is the most important pa- 
rameter, at step S560 the print job is changed in accord- 
ance with the specified quality, and the processing is 
normally terminated. 

For a case where the urgency is specified as the 
most Important, when the quality is set to the minimum 
quality of 1 , the printing period for the printer A521 is 50 
seconds, which conforms to the urgency setting. There- 
fore, the quality is set to the quality determination vari- 
able value (= 1), and the processing is normally termi- 
nated. 
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[Nineteenth Embodiment] 

Fig. 57 is a diagram showing the transmission of a 
print job and other information in a system in this em- 
bodiment employing apparatuses. The thick arrows de- s 
scribe the transmission routes for print jobs and the bro- 
ken line arrows describe the transmission routes for oth- 
er information. 

The print job in this embodiment includes parame- 
ters that are referred to during printing: a document to 
be printed; the number of print copies; the print quality; 
and the print size. The other information includes sta- 
tuses, such as printing, normal, or out of paper, of indi- 
vidual printers, and a schedule for a print job that is in- 
cluded in a print job scheduling unit 520. is 

In Fig. 57, in a client machine 510, a print job gen- 
eration unit 512 generates a print job and stores it in a 
print job memory unit 513. Then, the print job is trans- 
mitted by a print job transmission unit 514 in the client 
machine 510 to a server machine 511 for managing 20 
printers. 

In the server machine 511 , a print job reception unit 
516 receives the print job and transmits it to a print job 
interpretation unit 571. The print job interpretation unit 
571 interprets an instruction from a user that is included 2S 
in the received print job, and converts the instruction into 
information, such as a parameter, that can be processed 
by the system. When the parameters of the print job 
have not yet been set, the print job is transmitted to a 
print job automatic setup unit 51 7, and when the param- 
eters have already been set, the print job is transmitted 
to a print job automatic change unit 518. 

The print job automatic setup unit 517 sets print pa- 
rameters while taking Into consideration the urgency, 
economy and quality values that are acquired from the 3S 
print job. The print job automatic change unit 518 can 
perform the same process to change the parameters 
that have been set. The print jobs that are set or altered 
are registered in a print job schedule included In a print 
job scheduling unit 520 and are sequentially read to a 40 
print job transmission unit 51 9. or the print job is directly 
transmitted to the print job transmission unit 519 from 
the print job automatic setup unit 517 or the print job 
automatic change unit 518. The printing is then per- 
formed. 45 

The status, such as In printing, normal or out of pa- 
per, of an available printer is acquired by a printer state 
acknowledgement unit 515, and is transmitted to the 
print job automatic setup unit 517 and the print job au- 
tomatic change unit 518 where it is employed for the set- so 
up or change of the print job. Similarly, the printing 
schedule for the print job included in the print job sched- 
uling unit 520 is also transmitted to these units 517 and 
518 for their employment. 

As is shown in Fig. 57, a print job may be transmitted 55 
along a different route. When a machine for generating 
a print job is the same as a machine for managing print- 
ers, the print job may not be transmitted via the print job 



transmission unit 514. 

In this embodiment, as is shown In Fig. 58A, the pa- 
rameters of the print job are set ambiguously by using 
natural language. Fig. 58B is a diagram showing, rela- 
tive to an input character siring in the natural language, 
the meanings represented by character strings accord- 
ing tothe parameters and the items required to complete 
the meanings. The print job interpretation unit 571 refers 
to the meaning corresponding to an input character 
string in the natural language in Fig. 58B and the Item 
required to complete the meaning, and interprets the in- 
struction given in the natural language that is received 
as a print job setup parameter as foltows. 

From the character string "Print" in the input natural 
language, "printing" is the action that is the object of the 
user according to the meaning of the character string. 
Further, it Is assumed that the required item "object" in- 
dicates the contents of a print job that was input at the 
same time, and that "quality" and "number of sheets' 
should be designated at a portion in the input natural 
language that has not yet been Interpreted. Thus, the 
character string "one copy for client and five copies for 
members" Is interpreted as an instruction to print one 
"sheet" having a high "quality" and five "sheets" having 
a desired "quality". 

The processes hereinafter performed by the print 
job automatic setup unit 517 and the print job automatic 
change unit 518 are the same as those in the seven- 
teenth and the eighteenth embodiments. 

[Twentieth Embodiment] 

In this embodiment, as Is shown in Fig. 59, the print 
job parameters are set based on the distribution desti- 
nation described in a document, which Is the contents 
of the print job, and on the number of sheets. 

The action of the job is printing. 

Printing for a "client" is Interpreted as high quality 
printing, and the number of sheets is one. 

"ABC project" is interpreted as a "member use" and 
the printing quality is arbitrary, the number of sheets be- 
ing five. A user acquires In advance information that he 
or she is a member of the ABC project. 

The processes hereinafter performed by the print 
job automatic setup unit 517 and the print job automatic 
change unit 518 are the same as those in the seven- 
teenth and the eighteenth embodiments. 

[Twenty-first Embodiment] 

Fig. 60 is a diagram showing the transmission of a 
print job and other information in a system in this em- 
bodiment employing apparatuses. The heavy arrows 
describe the transmission routes for print jobs and the 
broken line arrows describe the transmission routes for 
another information. 

The print job in this embodiment includes parame- 
ters that are referred to during printing: the document to 
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be printed; the number of print copies; print quality; and 
print size. The other information includes statuses, such 
as printing, normal, or out of paper, of individual printers, 
and a schedule lor a print job that is included In a print 
job scheduling unit 520. 

In Fig. 60, in a client machine 510, a print job gen- 
eration unit 512 generates a print job, and stores it in a 
print job memory unit 513. Then, the print job is trans- 
mitted by a print job transmission unit 514 in the client 
machine 510 to a server machine 511 for managing 
printers. 

In the server machine S11, a print job reception unit 
516 receives the print job and transmits it to a print job 
interpretation unit 571. The print job interpretation unit 
571 interprets an instruction from a user that is included 
In the received print job, and converts the instruction Into 
information, such as a parameter, that can be processed 
by the system. When the parameters of the print job 
have not yet been set, the print job is transmitted to a 
print job automatic setup unit 517, and when the param- 
eters have already been set, the print job is transmitted 
to a print job automatic change unit 518. A print job sim- 
ulation unit 601 simulates printing at the setup that Is 
specified by the print job to acquire the period of time 
for the printing and the consumption of toner. 

The print job automatic setup unit 517 sets print pa- 
rameters while talking into consideration the urgency, 
economy and quality values that are acquired from the 
print job. The print job automatic change unit 518 can 
perform the same process to change the parameters 
that have been set. The print jobs that are set or altered 
are registered in a print job schedule Included in a print 
job scheduling unit 520 and are sequentially read to a 
print job transmission unit 51 9. or the print job is directly 
transmitted to the print job transmission unit 519 from 
the print job automatic setup unit 517 or the print job 
automatic change unit 518. The printing is then per- 
formed. 

The status, such as printing, normal or out of paper, 
of an available printer is acquired by a printer state ac- 
knowledgement unit 515, and is transmitted to the print 
job automatic setup unit 517 and the print job automatic 
change unit 518 where it is employed for the setup or 
change of the print job. Similarly, the printing schedule 
for the print job included in the print job scheduling unit 
520 is also transmitted to these units 517 and 518 for 
their employment. 

As is shown in Fig. 60^ a print job may be transmitted 
along a different route. When a machine for generating 
a print job is the same as a machine for managing print- 
ers, the print job may not be transmitted via the print job 
transmission unit 514. 

Fig. 61 is a flowchart showing the processing per- 
formed by the print job simulation unit 601. First, at step 
S61 1 , the print job simulation unit 601 initializes, in pre- 
paring for the simulation, a factor for determining the 
printing period and the consumption of toner. At step 
S612 the period of time for the printing is simulated at 



the setup that is also specified by the print job, and at 
step S61 3 the consumption of toner is simulated at the 
setup designated by the print job. In this manner, the 
period of time for the printing and the consumption of 
s ton er are acqu I red . 

A specific method Is the same as that explained in 
the seventeenth and the eighteenth embodiments. 

[Twenty-second Embodiment] 

in this embodiment, a plurality of output trays are 
provided for a printer, and a tray Is selected in conso- 
nance with a user. 

Fig. 62 is a flowchart showing the processing for a 
printer system In this embodiment. When a printer sys- 
tem receives a print job, first it performs a process for 
coping with a case where a plurality of print jobs are re- 
ceived at the same time, and then it Initiates the process- 
ing shown in Fig. 62. 

Figs. 63A and 63B are diagrams showing the exter- 
nal appearances of the printer systems in this embodi- 
ment. As is shown, printers 631 and 632 each have a 
plurality of output trays: for the printer 631 , each output 
tray is provided with a screen for displaying the name of 
the person to whom a document on the tray belongs; 
and for the printer 631 , the names of the persons whose 
document remain on which trays are displayed on a 
common screen. When a user is set in advance for each 
output tray, the individual trays are user dedicated trays. 
When the trays are not specifically assigned, the users 
of the output trays are changed as needed. 

The printer system in this embodiment implements 
the functions of notifying a user of the receipt of a doc- 
ument, the termination of printing, and the failure to col- 
lect a printed document (uses a sensor). 

The above processing will now be described. In Fig. 
52. at step S621 information concerning a destination is 
acquired from information included in a print job. The 
information concerning the destination is obtained, as is 
explained in the twenty-ninth embodiment, either by in- 
terpreting the setup described in the print job, or by ex- 
tracting it from information, such as E-mail, that is set 
separately from the contents of the print job. At this time, 
when, as in conventional use, a printer is employed as 
an output device for a personal computer, usually an ad- 
dressee is not designated. When the printer is employed 
as a facsimile machine or for transmission of E-mail, as 
in the system in this embodiment, an addressee is nor- 
mally designated. 

At step S622 a check is performed to determine 
whether or not an addressee is designated. At step 
S623 the addressee is notified of the arrival of a docu- 
ment. At step S624 the addresser information is ac- 
quired from the information Included in the print job. The 
addresser information is acquired, as is explained in the 
twenty-ninth embodiment, either by interpreting the des- 
ignation described in the print job, or by extracting it from 
information, such as E-mail, that is set separately from 
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the print job. When, as in conventional use, a printer is 
employed as an output device for a connnnon personal 
computer, normally the addresser falls within the control 
sphere of the system. However, when the printer is used 
as a facsimile machine, as In the system in this embed- s 
iment, usually the addresser is not within the control 
sphere. At step S625 a check is performed to determine 
whether the addresser is in the control sphere. At step 

5626 when the addressee is designated, a correspond- 
ing output tray is selected. When the addressee is not io 
specified and only the addresser is specified, an output 
tray corresponding to the addresser is selected. At step 

5627 the addresser or the addressee inlormation is 
transmitted to the corresponding output tray, as is 
shown in Fig. 63A. Or, as is shown in Fig. 63B, the ad- ^5 
dresser or the addressee Information and the output tray 
that is employed are displayed on the common display. 
When the user is set for each output tray, the individual 
trays are user dedicated trays. When the trays are not 
specifically assigned, the users of the output trays are 20 
changed as needed. 

At step S628 printing Is executed. At step S629 a 
check Is performed to determine whether the printing 
has been terminated and whether the addresser is with- 
in the control sphere. At step S630 the addresser Is no- 25 
tified of the termination of the printing. At step S631 a 
check is performed to determine whether a document 
has been left for a predetermined period of time and 
whether the addresser is in the control sphere. At step 
S632 the addresser Is notified that a printed document 30 
has been left in the tray for an extended time period. 

[Twenty-third Embodiment] 

In this embodiment, information concerning the 3S 
time is handled. Fig. 65 is a diagram showing the func- 
tional arrangement of a system according to the embod- 
iment. A processor 650 includes an understanding unit 
652, a planning unit 653, an execution unit 654, a re- 
sponse unil 655 and a knowledge base 656, and is con- 40 
nected to a database 651 . 

Fig. 64 is a flowchart showing the processing per- 
formed by the functional arrangement in Fig. 65 in this 
embodiment. 

At step S640 a check is performed to determine 45 
whether or not there is external input. If so, at step S641 
the understanding unit 652 employs the knowledge 
base 656 to analyze an Input document as the units of 
words and sentences, and at step S643 the object of the 
input contents is analyzed and ascertained. At step so 

5644 a check is performed to detennine whether infor- 
mation required for an understanding of the object is in- 
sufficient. If the information is unsatisfactory, at step 

5645 a query is issued to a user, and a response from 

the user is studied in the knowledge base 656. Program 5S 
control thereafter retums to step S643. If the Information 
Is adequate, program control moves to step S646. 
When, at step S640. there is no input, at step S642 a 



job to be executed is found and program control advanc- 
es to step S646. 

At step S646 the planning unit 653 prepares a plan 
to achieve the object. At step S647 acheck Is performed 
to determine whether information required for planning 
is insufficient. If the information is unsatisfactory, at step 
S648 a query is issued to the user, and a response from 
the user is studied in the knowledge base 656. Program 
control thereafter returns to step S646. If the Information 
is adequate, at step S649 the execution unit 654 exe- 
cutes the plan. At this time, the execution unil 654 ac- 
cesses the database 651 or communicates with another 
application, as needed. At step S650 the response unit 
655 determines whether or not a response should be 
made. If a response should be made, a decision Is made 
concerning the selection of the contents for the re- 
sponse. Further, at step S651 a response is prepared 
in accordance with the selected contents, and is trans- 
mitted to the user. 

The understanding unit 652 acknowledges, as 
needed, externally input information, such as keyboard 
input, voice input, E-mail or facsimile or news informa- 
tion, analyzes the received information and also the time 
concept contained in the words in sentences, and ob- 
tains an understanding of the contents of the sentences 
that are concerned with time. 

Fig. 67 is a diagram showing an example where 
schedule information is extracted from electronic mail. 
In the above process, specifically, as is shown In Fig. 
67, the contents of a document received by E-mail are 
analyzed, and the time concepts such as "February 
22nd". "13:00" and "15:00" are found and analyzed. 
Then, an understanding of the sentence concerning the 
concept, "We have scheduled a patent system explana- 
tion meeting at conference room B from 13:00 to 15:00 
on February 22" is obtained, and an action associated 
with the time can be correlated with the schedule. 

The analyzed time concept is compared with the 
current time. If the time concept describes the future, a 
corresponding action is registered in the schedule, but 
if the time concept describes the past, it is abandoned 
without being registered or it is registered as an infor- 
mation of a type other than thai for a schedule, such as 
information for a personal data base, that Is used to 
record past events. 

The understanding unit 652 analyses the contents 
of externally input information, such as keyboard input, 
voice input, E-mail, facsimile or news information. When 
the understanding unit 652 finds in the sentences a term 
(a word or a concept) that is unknown to the system, or 
a plan that the system has not yet executed, and when 
the word or the plan that is detected is not urgent, the 
understanding unit 652 studies the term or the plan by 
sequentially searching for information concerning it, and 
stores it as knowledge in the knowledge base 656. 

Specifically when, for example, the unknown term 
XYZ appears, the presence of XYZ is memorized, and 
sentences "XYZ is very delicious" and "XYZ is hard" are 
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analyzed to extract the concept that XYZ is hard, deli- 
cious food. 

Similarly, when a new plan is instructed and when 
from the current situation it is understood to be a plan 
for use when a user is absent, the understanding unit 
652 studies the plan as an example of how to make a 
plan for when a user is absent. 

In addition, when, for example, a system has been 
acquiring information concerning a user from news and 
notifying the user each time such information is found, 
and then upon the receipt of a notification that the user 
responds by sending the system an instruction in natural 
language that "from now on, there is no need to take 
notice of this information" the system can ascertain that 
transmission of the information is no longer necessary. 

As is described above, In the system, the under- 
standing unit 652 analyzes the contents of externally in- 
put information and also analyzes the object. The plan- 
ning unit 653 prepares a plan of an action for the system 
to take to ach ieve the object. The execution unit 654 per- 
forms the processing. And the response unit 655 notifies 
a user of the results of the processing. 

When, for example, It is ascertained, from infomna- 
tion concerning an addresser, upon the receipt of the E- 
mail message shown in Fig. 67 that the mail is from an 
addresser who is not registered in the database, infor- 
mation concerning the addresser is extracted from the 
message and is registered in the personal database in 
the database 651 . Further, when more information is ob- 
tained concerning the addresser who is not registered 
in the personal database, the information may be regis- 
tered in the personal database. 

Since the understanding unit 652 understands the 
message is for a notice for an explanation meeting, it 
accesses the schedule of a user in the database 651. 
and compares new schedule data with the current 
schedule data. When the new schedule data and the 
current schedule data do not conflict, the new data are 
additionally registered in the schedule. However, as is 
shown in Fig. 69, when the schedule data conflict, a re- 
ply to the addresser and a notice for a user are prepared. 

As is described above, since this system under- 
stands the contents of received information, the system 
can prepare a response in consonance with the situation 
and execute it. 

In the above explanation, the system prepares a re- 
ply to a user who sent the E-mail without confirming it 
with a user, and transmits the reply. This is because the 
sentence, "Please contact me as soon as possible if 
there is any difficulty" is in the message, and as a result 
of the analysis of this sentence, it is determined that a 
response is very urgently required. If the urgency of a 
response is determined to be low because a date for the 
holding the meeting is fairly advanced and the attend- 
ance at the meeting is arbitrary, the system confirms it 
with a user before transmitting a response. In other 
words, the system determines in which action to take in 
consonance with the degree of urgency. 



In addition, the schedule or the personal database 
can be accessed to transmit a response, relative to the 
input of the natural language by a user, as well as a nat- 
ural language instruction received from a user. 
5 For example, the personal database can be ac- 
cessed by asking the natural language question, "What 
is the telephone number of Mr. XX?". Or the schedule 
can be accessed when the natural language question, 
"Where will the meeting on the 16th be held?" is re- 
ceived, to send a reply to a user. 

Fig. 66 is a diagram showing the input/output types 
between the system that performs the overall process- 
ing in this embodiment and external devices. 

Input data can be data input via a keyboard, natural 
language information received by E-mail, documents or 
pictures input as images by a scanner, voice input via a 
microphone or images input by a camera. A character 
recognition process is preformed for a document that is 
read by the scanner, or a voice recognition process is 
performed for speech, so that input information in natu- 
ral language can be obtained. 

As for when there is no input (idle state), as is shown 
at step S642 in Fig. 64, when there is no external input 
the system searches for a job that it should execute and 
regards it as input. In the idle state, when no job is given 
to the system, the system, for example, accesses news 
and aggressively acquires as input information concern- 
ing the user. 

As for output, there are the registration of a sched- 
ule in a database, the filing or erasure of data relative 
to a file memory device, or the dispatch of a notice to a 
user or a reply to an addresser The importance of the 
output is that it can be determined that a process can 
not be performed within the control range of a system, 
and another action, such as transmitting a response to 
that effect, can be performed. 

An input/output destination is a user or an external 
device, or a different processor in the system or another 
application. 

In addition, input documents are analyzed, and data 
concerning a person and data concerning the time are 
extracted and stored in the personal database and the 
schedule database. Also, data required for the anticipa- 
tion of an action is extracted to use for planning. 

In the example in Fig. 67, as a result of analysis of 
an E-mail document that is input, the following descrip- 
tion concerning a person is acquired: 
To: toshima@abc.canon.co.jp, 
rohra@abc, canon. co.jp, 
kazuyo@abc.canon.co.jp 
From ichiro@abc.canon.co.jp 
I am Suzuki of system promotion section. 
Suzuki (ichiro@abc.canon.co.jp) 
044-123-4569 (ext. 654-3210) 

Canon Inc. Intellectual Property Head Office System 
Promotion Section 

Assuming that a person whose mail address is "ka- 
zuyo@abc.canon.co.jp" is already registered in the per- 
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sonal database and the other persons are not regis- 
tered, as is shown in Fig. 67, data for PERSON 1 , 2 and 
3 are extracted and registered in the database 651 . 

Since there is a description concerning the time, 
"We have scheduled a patent system explanation meet- 
ing at conference room B from 1 3:00 to 1 5:00 on Feb- 
ruary 22" data for EVENTI is extracted. 

Further, since there is a description used tor esti- 
mating an expected action, "Please contact me as soon 
as possible if there Is a difficulty" this is used for the 
processing to be explained while referring to Fig. 70. 

Fig. 68 is a specific flowchart for step 8649 pre- 
pared by extracting the portions from the flowchart in 
Fig. 64 that are required for performing the processes 
in Figs. 67 and 69. 

The processing will now be explained while refer- 
ring to Figs. 67 and 69. 

At step S680 E-mail Is input and at step S681 , of 
each word and sentence, the input E-mail document is 
analyzed. At step S683 it is ascertained from a signature 
and a header that "there is information concerning per- 
sons" and "an event, an explanation meeting, will be 
held". Further, it is ascertained that "a reply is requested 
if there is a difficulty". 

At step S684 the data concerning a person is ex- 
tracted and a plan for registering the data in a database 
and a plan for registering the explanation meeting event 
in the schedule are made. At step S685, it is ascertained 
that there is a plan to be executed. At step S686 it is 
found that there is no problem with the plan, and pro- 
gram control thereafter moves to step 8688, At step 
8688 the data concerning the person is extracted and 
registered in the database, and program control returns 
to step 8685. 

In Fig. 67, at step 8685 there is a plan to be exe- 
cuted: registration of the explanation meeting event in 
the schedule. At step 8686 it is assumed that the event 
can be registered in the schedule with no problem, and 
program control goes to step 8688. At step 8688 the 
event is registered in the schedule, and program control 
returns to step S685. At step 8685 there is no other plan 
to be executed, and at step S6B9 no acknowledgement 
receipt is required. The processing is thereafter termi- 
nated. 

In Fig. 69, at step 8685 there is a plan to be exe- 
cuted: registration of the explanation meeting event in 
the schedule, and at step S685 a conflict is found in the 
schedule. Since there is a problem with the execution 
of a plan, at step 3687 a reply to that effect is transmitted 
and a plan is made to notify a user that there is a prob- 
lem. At step S6B5 there is a plan for writing a reply and 
transmitting it, and at step 8686 no problem concerning 
the execution of the plan is found. At step S688, there- 
fore, a reply indicating that the timing is inconvenient is 
prepared and transmitted to the addresser. At step 8685 
there is a plan for preparing a document for notification 
of a user. At step 8686, there is no problem in execution, 
and at step 8688 a response to a user is prepared de- 



scribing that a reply was sent for reconsideration be- 
cause of the contents of the E-mail and the conflict of 
the schedules. At step 8685 there is no plan to be exe- 
cuted and at step 8689 since there is an notice to a user, 
s it is transmitted to the user. The processing is thereafter 
terminated. 

In the example in Fig. 69, when the schedule infor- 
mation EVENT1 that is extracted is compared with the 
schedule EVENT2 that is planned previously it is found 
10 that the two events conflict. Further, according to the in- 
formation extracted in the example in Fig. 69, it is ap- 
parent that a reply is necessary if there is a difficulty. In 
the system in this embodiment^ the knowledge for pre- 
paring letter is employed to write a letter describing that 
IS a user can not attend the meeting because the sched- 
ules are conflicting, and the reply is automatically trans- 
mitted. 

In addition, the user of the system in this embodi- 
ment is notified that the system automatically has trans- 
mitted a reply for the user. 

[Twenty-fourth Embodiment] 

Fig. 70 is a diagram showing an example where a 
user sends a question by voice to a system according 
to this embodiment. 

When a user asks by voice "where will tomorrow's 
conference be held?", the system can examine the 
schedule information of the user and tell the location of 
the conference. 

When the user does not know how to get the loca- 
tion for the conference and asks "In which area in 8hi- 
momaruko?", the system examines the database, per- 
forms planning for an explanation to make a user under- 
stand, prepares a briefing story, and uses graphical im- 
ages and sounds to explain how to get the location. 

Fig. 71 is a flowchart showing the processing per- 
formed in Fig. 70 by referring to the basic flowchart in 
Fig. 64. An external input is regarded as a query. 

The processing relative to a first inquiry will be ex- 
plained. At step 8710 voice (where will tomorrow's con- 
ference be held?) is externally input, and at step S711 
the input sentence is analyzed. At step 871 2 it is under- 
stood that the input sentence is an inquiry for the con- 
ference, and that the object of the user is to know the 
location of the conference. At step 8713 the following 
planning is performed to answer the inquiry (1 ) Tomor- 
row's schedule is extracted. (2) The location registered 
In the schedule is acquired. (3) A reply is prepared lo 
tell the acquired location. 

At step 8714 information is sufficient and program 
control moves to step 871 6. If the schedule show a plu- 
rality of conferences, the system does not Identify which 
conference is. Therefore, at step S715 a query is sent 
to a user to remake a plan. At step 8716 the plan made 
at step 8713 is executed, and a reply document to the 
user is prepared. At step 87 17 it is ascertained that there 
is a response to the user, the system determines the 
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transmission of tine response. At this tinne, since it is un- 
derstood that the input was done by voice, transnnission 
of the reply by voice is also determined. At step S718 
the response, which is voice data obtained by conver- 
sion, Is transmitted to the user. 5 

The processing is temporarily terminated, and fol- 
lowingthis, an inquiry from the user is input. Theprocess 
relative to the second inquiry will now be described. 

At step S710. voice (In which area in Shimomaru- 
ko?) is input externally, and at step S711 the input sen- 
tence is analyzed. At step S71 2 it is understood that this 
inquiry is a continuous question of the first one, and also 
that a specific location of the place name that was an- 
swered is being asked. 

At step S713 the following plans are made to re- 
spond the question: (1) a plan for explaining that it Is 
difficult to explain the location by writing; (2) a plan for 
explaining the location by sequentially sending images; 
(3) a plan for acquiring necessary images from an image 
database and a location database; and (4) a plan for 
preparing sentences corresponding to images. 

At step S714 the information is adequate, and at 
step S716 the plans made at step S71 3 are sequentially 
executed and a reply to a user consonant with the im- 
ages Is prepared. At step S717, since there is a reply 
document to be transmitted to the user, the transmission 
of the response is determined. At this time, it is under- 
stood that the input was done by voice, so that it is also 
determined that explanation will be given by voice while 
displaying images on a monitor. At step S718 the re- 
sponse Is transmitted to the user. The processing se- 
quence in Fig. 70 is thereafter terminated. 

[Twenty-fifth Embodiment] 

In an example shown in Fig. 72, when two sched- 
uled events conflict, the order of priorities of the two 
events is obtained from a comparison, and a plan to han- 
dle this problem is prepared and proposed to a user. 

That is, in this example, when one schedule is found 
to be more important than the other, it Is proposed that 
the less important schedule be canceled. 

If the user knows somebody to send as his or her 
proxy to the scheduled event for which cancellation is 
proposed, the user can send the system a response to 
that effect. The system can then perform an action in 
consonance with the response. Also, the system can 
study a plan for despatching another person as a proxy. 

In Fig. 72 is shown a combination of other methods 
performed at step S646 in Fig. 64 to make plans when 
the schedule conflict Is found at step S686 In the flow- 
chart in Fig. 68. 

The processing in Fig. 68 has been explained for 
unconditionally transmitting to a user a response for an 
inconvenience. In this embodiment, the processing for 
a plurality of plans is employed as the re-planning meth- 
od at step S646. 

Fig. 73 Is a flowchart for evaluating a priority extract- 



ed from the contents of a document and for proposing 
it to a user. The processing will now be explained. 

The priorities of the scheduled events is determined 
by using information that the user has set in advance for 
each schedule, attendance at an event Included in the 
schedule, the object of a scheduled event and the result 
obtained as a result of the analysis of the received doc- 
ument. A user may set the priorities of persons that are 
expected to attend the pertinent event. 

The priority determined according to the object of 
the schedule may be set in advance by a user, or may 
be determined while taking into account the object or 
the field that the system understands, from the study of 
the past, that the user is interested in. That is, when the 
user engages in computer associated work, the sched- 
ule for a computer associated event priority over an 
event associated with real estate. Of course, if a user 
plans to purchase a house and that data is stored as 
information concerning the user the schedule of an 
event associated with real estate may take priority. 

For the priority determined from the result of the 
analysis of the document, when a document including 
the sentence "Please be sure to attend the meeting" and 
a document including the sentence "Please attend the 
meeting if possible" setup a conflict, the first document 
received is determined to take priority. 

In Fig. 73, at step S730 the current schedule infor- 
mation is acquired. At step S731 the priority for new 
schedule information is evaluated. At step S732 the pri- 
orities of both schedules are compared. At step S733 
from the result of the comparison, a plan is made to pre- 
pare a notice for querying a user (e.g., display two con- 
flicting scheduled events and ask whether the event 
having the lower priority can be canceled). At step S734 
the prepared notice is transmitted to the user. At step 
S735 a response from the user relative to the inquiry 
concerning the plan is acquired. The same re-planning 
process as in Fig. 68 is performed to again prepare a 
plan by using the response obtained from the user so 
that an action consonant with the response of the user 
can be taken. 

Fig. 74 is a flowchart showing the re-planning proc- 
ess. 

At step S740 the response finally obtained in Fig. 
73 is regarded as input. At step S741 the input sentence 
is analyzed. At step S742 it is ascertained that the 
schedule is to be changed and that this is the first in- 
structed plan. 

At step S743 the following plans are made: (a) the 
changing of the schedule; (b) the preparation of a doc- 
ument to transmit the schedule to a proxy; (c) the study 
of a new plan ; (d) the preparation of a document to trans- 
mit the new plan to the user; and (e) the notification sent 
to a user concerning another schedule that should be 
recalled. 

At step S744 the plans made at step S743 are ex- 
ecuted: (a) the schedule is changed; (b) a document is 
prepared to transmit the schedule to a proxy: (c) a new 
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plan is studied; (d) a document is prepared to transmit 
the new plan to the user; and (e) a user is notified of 
another schedule that should be recalled. 

At step S745 the notification docunnent is transmit- 
ted to the user The processing for performing the proc- 
ess in Fig 72 is thereafter terminated. 

[Twenty-sixth Embodiment] 

Fig. 75 is a diagram illustrating the overall image of 
a system according lo this embodiment, including input/ 
output devices. Fig. 76 is a flowchart showing the 
processing performed by the system in Fig. 75. 

Information input by E-mail, by voice, via a key- 
board, across the WWW, and by input devices, such as 
a telephone, a facsimile machine, a scanner and a cam- 
era, is analyzed by an Input management unit 751 (step 

5760) . A core unit 752 ascertains the contents of the 
information and plans an appropriate process (step 

5761) . An output management unit 753 determines an 
output medium and prepares the contents to be output 
and an output route (step S763). Then, the Information 
is output by E-mail, by voice, across the WWW, or by 
output devices, such as a telephone, a facsimile ma- 
chine, a printer and a copier. 

Figs. 77 to 79 are specific flowcharts showing the 
process at step S760 (the process performed by the in- 
put management unit 751), at step S761 (the process 
performed by the core unit 752) and at step S763 (the 
process performed by the output management unit 
753). 

In Fig. 77, when, at step S770, it is determined that 
there is new input, at step S771 the input information is 
obtained. At step S772the input Information is analyzed, 
as needed, after the information has been identified. At 
this time, the input management unit 751 accepts infor- 
mation from various media and Identifies or analyzes the 
data using methods corresponding to the individual me- 
dia. 

In Fig. 78. the core unit 752 receives the information 
that is analyzed in Fig. 77. 

At step S780 the object of the input information is 
analyzed andascertained from the result of the analysis. 
At step S781 how the object of the input information is 
related to the main apparatus (the system or the user) 
is examined. At step S782, from the relationship with the 
main apparatus, planning for what to execute is per- 
formed in consonance with the object. At step S783 the 
plan made at step S782 is executed. 

In Fig. 79 the output management unit 753 employs 
the results obtained in Fig. 78 to determine whether a 
response is needed. If a response Is required, It is pre- 
pared and output. 

At step S790 the result obtained in Fig. 78 is ana- 
lyzed. At step S791 a check is performed to determine 
whether or not there is a response relative to the results. 
When there is no response, the processing is thereafter 
terminated. If there is a response, at step S792 a re- 



sponse relative to the external response is determined. 
At step S793 a medium for the response is determined. 
At step S794 a response is prepared in consonance with 
the designated medium. At step S795 the prepared re- 
s sponse is Issued by the designated medium. At step 
S896 the response Is actually output. The processing 
performed by the arrangement in Fig. 75 has been ex- 
plained. 

When, for example, E-mail is received that notifies 

10 the user of the holding of a conference, the input man- 
agement unit 751 analyses the input information accord- 
ing to the procedures in Fig. 77. From the obtained re- 
sult, the core unit 752 prepares a plan, according to the 
procedures in Fig. 78, as to how the user and the system 

^5 should handle the Information. The plan is transmitted 
to the output management unit 753, which In tum per- 
forms the process according to the procedures in Fig. 
79. When a response should be transmitted with the 
plan, a response is actually prepared and transmitted. 

^0 Depending on the contents of the conference de- 
scribed in E-mail message and the status of the sched- 
ule of the user, at step S782 a plan Is prepared for the 
aggressive transmission of the response to the user, so 
that preparation of the response is required. At step 

25 S791 , therefore, it is determined that a response is to 
be transmitted. At step S792 the contents of the re- 
sponse are determined. When the schedules conflict 
and when it is uncertain which schedule should be se- 
lected or whether a user Intends to attend a specific con- 

30 ference, the contents of a response asking for a decision 
are determined. At step S793 a medium is selected by 
which the contents of the response can be transmitted 
most effectively. When, for example, the user is outside 
the office, a medium, such as a telephone or a facsimile 

55 machine, is selected that can issue a notice to the user. 
When the user is being operating a personal computer, 
a medium, such as a personal computer, is selected that 
can effectively display various reference materials. At 
steps S794 and S795 a document and an image are pre- 

40 pared in consonance with the contents and the medium 
that are decided above, and a response is prepared us- 
ing a method for converting the data into voiced natural 
language in consonance with a specific medium, and is 
issued. 

45 Fig. 80 is a detailed flowchart for Fig. 75 to explain 
the processing for extracting data from input informa- 
tion. In this system according to the embodiment, when 
a document is Input, at step SS01 type identification 
symbols, such as the layout and a bar code of a docu- 

50 ment, are employed to infer the document type. If the 
document is inferred to be a letter, a report or a patent 
publication, program control moves to step S803. When 
no identification of the document is possible, program 
control goes to step S810 whereat OCR Is thoroughly 

55 performed to ascertain the document type. 

At step S803, in order to confirm the inferred docu- 
ment type is correct, a characteristic block is interpreted 
by the OCR to identify the document type (see Figs. 82A 
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and 82B). At step S804 the addressee of a letter and 
the patent serial nunnber of the patent publication are 
found and the document type is confirmed. When the 
confirmed document type matches the inferred docu- 
ment type, program control advances to step S806. If 
the document types do not match, program control 
moves to step S810. For slips, at the top of which char- 
acter strings describing the slip type are printed, the doc- 
ument type can be easily determined by the OCR on the 
employing upper portion of the sheet. 

At step S806 the knowledge base of the document 
type that has been confirmed Is employed to read and 
interpret a specific block using OCR. At step S807 a 
check is performed to determine whether there was in- 
formation in the past that concerns the resultant infor- 
mation. If such information was present, program con- 
trol moves to step S808. If such information was not 
present, program control goes to step S81 0. As a result, 
the addressee or the patent number is found and wheth- 
er the information is a reply to a letter that was sent in 
the past can be ascertained. 

At step SB08, based on the identified status, the ob- 
ject is decided from the contents of the important text, 
and at step S809 a process to be executed is deter- 
mined. 

At step S811 , because of the above object, the in- 
formation is analyzed in another range where OCR has 
not yet been performed. At step S812 a required proc- 
ess is actually performed. As a result, a filing process, 
etc., is perfomned as needed. 

In the above process, the OCR can be performed 
while inferring the contents of the Information, more ef- 
ficient and precise OCR results can be obtained than 
when, as in the conventional case, the OCR use is ef- 
fected from the beginning. Accordingly, the process 
based on the OCR results can be performed precisely. 

Fig. 81 is a diagram showing an example letter/fac- 
simile that is a target for data extraction. 

In this example, at step S801 the document type is 
inferred from the layout of a document. As a result, Doc- 
Typel = letter/fax. 

At step S803 a specific block is read by the OCR 
and is interpreted (see Figs. 82A and 82B). Then, 
"From", "To" and "Dear Sir" are acquired, and at step 
S804 DocType2 = letter/fax. 

The process for reading a specific block by using 
OCR, which was explained at step S803 in Fig. 80, will 
be specifically described. Figs. 82A and 82B are dia- 
grams for explaining this process. 

The system in this embodiment scans a specific 
block as follows; 

(1 ) A specific block is read fast by pre-scanning with 
a low resolution. 

(2) A form of the information that is read is com- 
pared with an information form stored in a DB 823. 
When the forms match, input information other than 
the form, or information in an area (e.g., inside the 



frame of a card in Figs. 82A and 82B) specified for 
each form, is read at a high resolution. 
(3) Only the area that is read is regarded as an OCR 
target and analyzed, and the processing is contin- 
5 ued. 

In addition, since in this example it is assumed that 
there are a plurality of cards having the same form, doc- 
uments that are to be read at a predetermined interval 

10 probably have the same form. Therefore, first, the proc- 
ess is performed while it is assumed that the documents 
have the same form, and when a contradiction occurs, 
it is assumed that the documents have different forms 
and a re-analysis of them is performed. 

7^ As a result, the processing speed is considerably 
increased, the analysis range is limited, and an analysis 
domain is determined by specifying a form, and the anal- 
ysis precision is drastically improved. 

The determination of the object from the contents 

20 of the information, which was explained at step S808 in 
Fig. 80, will be specifically described. 

The system in this embodiment employs date data 
to perform the determination process according to the 
procedures in Figs. 83A and 83B. When a sender is a 

2S user the following process is performed. 

(1 ) When the current date is today, transmission by 
facsimile is decided. 

(2) When the date is yesterday or some time in the 
30 past, the user is queried as to whether the same 

document was received before or whether he or she 
has seen the same contents, in order to determine 
whether to perform filing, re -transmission, or wheth- 
er the user made a mistake. 
35 (3) When the date is tomorrow or some day in the 
future, the user is queried in order to determine 
whether the information should be held until the 
designated date, or whether the user made a mis- 
take. 

40 

More specifically, assuming that in a document in 
Fig. 81, Datel is the date of a document, Date2 is the 
today's date. 

45 (1 ) Datel = November 25, 1 996 & Date2 = Novem- 
ber 25, 1 996 - send the document 

(2) Datel = November 25, 1996 & Date2 = July 2. 
1 996 ~ filed 

(3) Datel = November 25, 1 996 & Dale2 = Novem- 
50 ber 26, 1 996 

Date of contents = December 18 and 22, 1996 

mistake 

Figs. 83A and 83B are flowcharts showing the 
55 processing for analyzing the object extracted from an 
input document. When a document is input, at step S830 

a check is performed to determine whether the sender 
is a user. If the sender is a person other than a user, the 
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input document is determined to be a received docu- 
ment. At step S831 a corresponding object, such as fil- 
ing or data extraction, is examined, and the processing 
is thereafter terminated. 

When the sender is a user, program control advanc- s 
es to step S832 to analyze the type of the input docu- 
ment. At step S833 the date of the document is com- 
pared with the current date. When the two dates are 
close to each other, at step S835 a check is performed 
to determine whether the document was transmitted be- 
fore. When the document was not transmitted before, 
its object is determined to be "transmission of a docu- 
ment". If the same document was transmitted before, at 
step S843 the object for filing or re-transmission is ex- 
tracted. 15 

When the date of the document is a fairly old date, 
program control moves to step S836, whereat a check 
is performed to determine whether or not the same doc- 
ument was transmitted before. When the document was 
transmitted before, program control moves to step 20 
S843. When the document was not transmitted, pro- 
gram control goes to step S837 whereat a check is per- 
formed to determine whether any other date is de- 
scribed in the information for the document. When there 
is another date, program control goes to step S843. 2S 
When no other date is found, it is ascertained that the 
object can be transmission of the document, and also 
that the date may be wrong. 

When the date of the document is a date fairly far 
in advance, at step S840 a check is performed to deter- 30 
mine whether any other date is described in the infor- 
mation for the document. When, at step S841 , there is 
another date, the object is determined to be "transmis- 
sion of the document". When no other date is found, pro- 
gram control moves to step S839, 3S 

[Twenty-seventh Embodiment] 

Fig. 84 is a diagram showing an example arrange- 
ment of a system according to this embodiment. In this 40 
embodiment, the system serves as a current facsimile 
machine. 

According to the system in this embodiment, with- 
out a user specifying an addressee, the addressee for 
a document is determined from bar code on a document 4S 
that is read or information on a cover sheet, so that the 
document can be transmitted to a correct addressee. 

As a result, appropriate information can be trans- 
mitted to a printer or a facsimile machine, by E-mail or 
via the WWW. so 

[Twenty-eighth Embodiment] 

Fig. 85 is a diagram illustrating an example arrange- 
ment of a system according to this embodiment. In this 
example, the system implements a desk sorter function 
for processing all the kinds of documents on the desk. 

That is, in consonance with the contents of the doc- 



ument that is read, sorting, filing, scheduling, data ex- 
traction and automatic processing are performed. 

[Twenty-ninth Embodiment] 

Fig. 86 is a detailed diagram for explaining the sys- 
tem in Fig. 85. The processing performed by the system 
shown in Fig. 86 will be specifically described while re- 
ferring to the flowchart in Fig. 87. 

Fig. 87 is a flowchart showing the processing for this 
embodiment. Figs. 88 and 89 are tables for knowledge 
used during the processing; the table in Fig. 88 shows 
the knowledge in general knowledge base, and the table 
in Fig. 89 shows the knowledge in a knowledge base of 
a field specified on a cover sheet. In this embodiment, 
information defined in the tables in Figs. 88 and 89 is 
employed to compare a character string included in an 
input document with a character string defined in a char- 
acter string column in the table, and the conception in a 
corresponding column, a Role for further specifying the 
meaning, and a Condition for specifying succeeding in- 
formation, or an instructed process Action are acquired, 
and analysis for them is performed. 

In Fig. 87, at step S870 a cover page is scanned 
and an OCR process is performed. At step S871 the 
knowledge base in Fig. 88 is examined to extract from 
it data, such as the names of a sender and a receiver 
and their telephone numbers and facsimile numbers. At 
step S872 the obtained data are registered in a data- 
base. In the example in Fig. 86, character string "To: 
Macrohard Corp." is included in the cover page of a re- 
ceived document. When this character string is com- 
pared with an item defined in the character string column 
in Fig. 88. Then, matching item "To" is found and its Role 
is a reception company name or an individual name, so 
that "Macrohard Corp. " is extracted as information con- 
cerning a receiver. 

At step S873 a notification method and means, a 
filing job, an action for a place, and a job are extracted. 
In the example in Fig. 86, character string "File: MH/ 
Contract" is included in the cover page of the received 
document. When this character string is compared with 
the items defined in the character siring column in Fig. 
89, matching rtem "File" is found, filing is extracted from 
the column as an instructed action, and "MH/Contract" 
is extracted from the document as information for a filing 
place. 

Assuming that Datel = November 25, 1996 and 
Date2 = November 25, 1996, as is explained in Figs. 
83A and 83B, it is determined that the object is trans- 
mission of a document. 

At step S874 a check is performed to determine 
whether an action for the object of the processing is 
present. Since the transmission of the document to a 
receiver is the object, at step S875 a transmission action 
is performed. At step S876 the information on the cover 
page is employed to determine whether the filing is nec- 
essary. Since the filing is required in the example in Fig. 
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86, at step S877 the document Is filed at the instructed 
place, ••MH/Contract". 

At step S878 as well as at step S876 the information 
on the cover page is employed to determine whether or 
not a notification for the transmission of the document s 
should be issued to the sender. Since it is instructed to 
notify the sender, by voice, of the transmission of the 
document, at step S879 the sender is notified by voice 
of that the document has been transmitted to the receiv- 
er At step S880 whether or not another action is deter- io 
mined. At step S881 a keyword is designated, and an 
index is prepared by using keyword ABC. 

[Thirtieth Embodiment] 

IS 

Fig. 90 is a diagram showing an example process- 
ing where the history in the past is referred to based on 
an Instruction by voice in natural language. The 
processing in Fig. 90 will be explained while referring to 
the flowchart in Fig. 91 . so 

Fig. 91 is a flowchart showing the processing for this 
embodiment. When an aural Instruction "Fax Contract 
again to John. Notify him by Phone" is received from a 
user, the system analyzes the object of the instruction 
in the natural language, and understands "Re-transmit 2S 
document "Contract" to John, and Notify him of the 
transmission". Thus, the processing in Fig. 91 is initiated 
to specify the document Contract and the addressee 
John. 

Since re-transmission means that the document 30 
was previously transmitted, at step S910 history infor- 
mation is acquired from the database. Then, the docur 
ment Contract and the addressee John are specified 
from the history information. At step S911 the address 
of the John is obtained from the personal database. 35 
Since, in the database, there are two Johns, John Smith 
and John Bush, ordinarily the addressee can not be 
specified. Since at step S910 the history information is 
referred to, however, it is judged that John to whom the 
document Contract was transmitted is John Smith, and 40 
the addressee is thus specified. At step S912 the doc- 
ument "Contract" is acquired from the tiling database. 
At step S91 3 the document is transmitted to addressee 
John. Since there is notice instruction "Notify him by 
Phone" at step S91 4 it is determined that transmission 
of the notice is necessary. At step S915, as well as in 
Fig. 89, according to the rule of the knowledge base, an 
Instruction is issued to a facsimile machine 901 as a re- 
ception apparatus to send a notice to a receiver by 
phone. At step S91 6 the other actions are not instructed, so 
and program control thereafter determined. 

Upon the receipt of the document, according to the 
notification instruction, the facsimile machine 901 noti- 
fies John by phone of the receipt of the document from 
Mr. Doors. When the facsimile machine 901 can not no- 55 
tify the addressee by phone of the receipt of the docu- 
ment, the addressee may take its place. 



[Thirty-first Embodiment] 

Fig. 95 is a flowchart showing example processing 
where, from the contents of a document that is input and 
analyzed, it Is determined that a user should do some- 
thing, a query is actually transmitted to the user, and a 
required process is preformed automatically. Fig. 92 is 
a diagram showing an example input document. Fig. 93 
is a diagram showing the contents of a conversation be- 
tween a system and a user Fig. 94 Is a diagram showing 
a document that is prepared by the system as the result 
of judgement of the conversation in Fig. 93. 

The processing for preparing an output document 
In Fig. 94 from an input document in Fig. 92 will be de- 
scribed while referring to the flowchart in Fig. 95. 

At step 8950 the input document in Fig. 92 is ana- 
lyzed and the following objects are understood: (a) Mr 
John Smith arrives at Yokohama at three o'clock on No- 
vember 28; (b) Mr John Smith little understands Japa- 
nese; and (c) some one should meet him at the station. 

At step S951 what the user should do is determined 
from the contents that are obtained. Since it is deter- 
mined that some one must meet him at the station, pro- 
gram control advances to step S952. At step S952 a 
check is performed to determine whether a proxy (sys- 
tem) may execute the action. Since the system can not 
meet him at the station, program control goes to step 
S953. At step 8953 a check Is performed to detemriine 
whether an inquiry should be issued to the user, and if 
so, program control moves to step S954, In this exam- 
ple, since It is determined from the addressee of the in- 
put document that this is a request for Dr Aruna Rohra, 
program control moves to step S954. 

At step S954 a process for inquiring the user (Dr 
Aruna Rohra) is performed. In this case, as the result 
obtained at step S951 the user must meet John at the 
station, and an inquiry what to do is issued to the user 
At step S955 what to do next is determined from the re- 
sult of the Inquiry, and whether or not an action Is to be 
initiated Is determined. In this example, the user In- 
structs to ask Mr. Tanaka to meet him, the action Is Ini- 
tiated according to the Instruction. Since there is a re- 
quest for Mr. Tanaka to act as a proxy, it is assumed that 
the action must be initiated. At step S956 a document 
for requesting Mr. Tanaka as a proxy is prepared and a 
contact is made with Mr. Tanaka. In this example, an 
electronic mall document is prepared and transmitted. 
In this example, information that John arrives on 28th, 
an instruction for meeting him for the user and the orig- 
inal document that caused the request are attached to 
automatically form the document. 

As is described above, processing has been ex- 
plained for performing the matter {meeting John at the 
station) where from the input document the user must 
actually perform an action. 
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[Thirty-second Embodiment] 

Fig. 96 is a diagram illustrating a thirty-second em- 
bodiment where a system is operated by a controller. 

According to the system in this embodiment, devic- s 
es and a controller directly or Indirectly communicate 
with each other to specify the other. 

Therefore, the following functions are provided: (1) 
automatic specifying of a device; (2) acquisition of a de- 
vice capability from the device; (3) a Ul (User Interface) 
inherent to a device; (4) operation by voice; (5) common 
basic operation for all the devices; (6) a Ul inherent to 
a user: and (7) a Ul having a high degree of freedom in 
consonance with the status 

That is, (1) only when a controller faces an operat- 
ing target device, it automatically recognizes the target 
device; (2) information for each device is acquired from 
the pertinent device via IrDA or via a wireless LAN; (3) 
a Ul inherent to each device is provided from the infor- 
mation for the device; (4) an operation by voice can be 
performed; (5) common basic operation can be provided 
by using the same controller; (6) user identification in- 
formation is employed to acquire necessary information 
for each user from the database or the address book 
and to Implement the Ul inherent to the user; and (7) the 
optimal Ul is provided in consonance with the status. 

In Fig. 96 since a controller 960 faces a facsimile 
machine 963, It acquires model identification informa- 
tion from the facsimile machine 963, and renders a Ul, 
which corresponds to the model, active. Then, following 
the displayed "Fax to" character string "Fax to John" is 
Input with a touch pen, and transmitted to the facsimile 
machine 963. John's facsimile number is read from an 
address book 965 in a personal computer 964, and a 
document set in the facsimile machine 963 or a docu- 
ment designated on a file in the personal computer 964 
is transmitted to the fax number. The detailed process- 
ing will be described later 

[Thirty-third Embodiment] 

Fig. 97 is a diagram showing a status monitor 

In a system according to this embodiment, informa- 
tion of an apparatus that is other than the apparatus that 
a user directly operates can be referred to. 

Therefore, the following functions can be provided: 
(1 ) remote and handy management; (2) specifying of au- 
tomatic device; (3) common input/output for examining 
a status; (4) the same function as a portable telephone; 
(5) operation by voice; and (6) handling of all the devices 
that can input/output infrared rays. 

That is, (1) required Information can be acquired 
even from a remote area from a target device; (2) only 
when a controller faces the target device, it can auto- 
matically recognize the target device; (3) common basic 
operation can be provided by using the same controller; 
(4) the usability is enhanced by providing the portable 
telephone function for the controller; (5) operation by 



voice can be performed; and (6) the common protocol 
is employed to cope with all the devices that can input 
and output infrared rays. 

In Fig. 97, a status monitor 970 selects a printer 961 , 
a copier 962 or a facsimile machine 963, and character 
string "Status" is input with a touch pen and instructed. 
The status monitor 970 retrieves status information from 
the device that the status monitor 970 faces, so that the 
user of the status monitor 970 can confirm the statuses 
of the devices. Even when a personal computer 964 is 
located at an area where a command from the status 
monitor 970 can not reach, the status of the personal 
computer 964 is requested to a printer 961 , which can 
communicate with the personal computer 964 via the 
network. Then, the status information can be retrieved 
to the status monitor 970 from the personal computer 
964 via the network and the printer 961 . 

[Thirty-fourth Embodiment] 

Fig. 98 is a diagram showing an example where a 
controller 960 recognizes a target model, and a corre- 
sponding Ul is read from the controller 960 and dis- 
played. The controller 960, which does not face a target 
device, has a default screen on which message "Select 
a device which you would like to use" is displayed, as is 
shown in the center in Fig. 98. 

The communication between the controller and the 
target model will now be described. It should be noted 
that (2) and (3) are not necessarily required. When, for 
example, in (4) a target model generates a signal to the 
controller at predetermined Intervals, the same effect 
can be obtained. The positional relationship between 
the controller 960 and a target model may be employed 
to determine that the controller 960 selects the target 
model. Further, in (4) the controller 960 may identify a 
target model by examining the shape of the model, or 
by reading the bar code attached to the target model. In 
other words, only the essential portion is shown in Fig. 
98. 

(1 ) A user directs the controller 960 to a target mod- 
el. 

(2) The user touches a touch panel on the controller 
960 in order to determine the timing at which the 
controller 960 transmits to the target model a target 
model identification signal request signal. Or, the 
controller 960 is set in advance to transmit a target 
mode) identification signal request signal at a pre- 
determined Interval. 

(3) The controller 960 transmits a target model iden- 
tification signal request signal to the target model. 

(4) A target model identification signal is transmitted 
upon the receipt of the target model identification 
signal request signal from the controller 960, or ac- 
cording to the setup that a target model identifica- 
tion signal request signal at a specified interval. 

(5) The controller 960 that receives the target model 
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identification signal determines a Ul in consonance 
with a target nnodel indicated by the signal, and dis- 
plays a corresponding Ul internally stored. In this 
case, the identification signal is provided for each 
model; however, when an identification signal is 
provided for each device, a different Ul can be em- 
ployed for each of devices though they are the same 
model. 

Fig. 99 Is a flowchart showing the processing per- 
formed by the controller 960 when the controller recog- 
nizes a target model, and reads and displays a corre- 
sponding Ul. The processing performed by the control- 
ler 960 will now be described. 

At step S991 the controller 960 waits until an in- 
struction from a user is input. At step S992 a target mod- 
el identification signal request signal is transmitted by 
an infrared ray communication method in order to obtain 
a target model identification signal from the target mod- 
el. At step S993 the controller 960 wails until the target 
model outputs a target model identification signal. At 
step S994, the Ul corresponding to the received target 
model identification signal is acquired from internal 
memory and is displayed. 

Fig. 100 is a flowchart showing the processing per- 
formed by a target model when the controller 960 rec- 
ognizes a target model, and reads and displays a cor- 
responding Ul. The processing performed by the target 
model will now be described. 

At step S1001 , the target model waits for a request 
signal from the controller 960. At step S1002 the target 
model transmits a target model identification signal by 
an infrared communication method, etc. 

[Thirty-fifth Embodiment] 

Fig. 101 is a diagram showing an example where a 
controller 960 receives a Ul from a target model and dis- 
plays it. The controller 960, which does not face a target 
device, has a default screen, as is shown in the center 
in Fig. 101. 

The communication between the controller and the 
target model will now be described. It should be noted 
that (2) and (3) are not necessarily required. When, for 
example, in (4) a target model generates a signal to the 
controller at predetermined intervals, the same effect 
can be obtained. The positional relationship between 
the controller 960 and a target model may be employed 
to determine that the conlroller 960 selects the target 
model. Further, in (4) the controller 960 may identify a 
target model by examining the shape of the model, or 
by reading the bar code attached to the target model. In 
other words, only the essential portion is shown in Fig. 
101. 

(1 ) A user directs the controller 960 to a target mod- 
el. 

(2) The user touches a touch panel on the controller 



960 in order to detemnine the timing at which the 
controller 960 transmits a Ul request signal to the 
target model. Or, the controller 960 is set in advance 
to transmit a Ul request signal at a predetermined 
interval. 

(3) The controller 960 transmits a Ul request signal 
to the target model. 

(4) A Ul signal is transmitted upon the receipt of the 
Ul request signal from the controller 960, or accord- 
ing to the setup that a Ul request signal at a speci- 
fied interval. 

(5) The controller 960 that receives the Ul signal dis- 
plays the Ul. 

Fig. 1 02 is a flowchart showing the processing per- 
formed by the controller 960 when the controller re- 
ceives a Ul from a target model and displays it. The 
processing performed by the controller 960 will now be 
described. 

At step SI 021 the controller 960 waits until an in- 
struction from a user is input. At step SI 022 a Ul request 
signal is transmitted by an infrared ray communication 
method in order to obtain a Ul signal from the target 
model. At step SI 023 the controller 960 waits until the 
target model outputs a Ul signal, at step SI 024, the re- 
ceived Ul is displayed. 

Fig. 1 03 is a flowchart showing the processing per- 
formed by a target model when the controller 960 re- 
ceives a Ul from a target model and displays it. The 
processing performed by the target model will now be 
described. 

At step S1031 , the target model waits for a request 
signal from the controller 960. At step S1032 the target 
model transmits a Ul signal by an infrared communica- 
tion method, etc. 

[Thirty-sixth Embodiment] 

Fig. 104 is a diagram showing an example where 
Uls of devices are stored in a wireless LAN server 1041 
and when a controller 960 faces a copier 962 as a target 
model and requests a Ul, a Ul is transmitted, upon a 
request from the copier 962, from the wireless LAN serv- 
er 1041 to the controller 960, and is displayed. 

The controller 960, which does not face a target de- 
vice, has a default screen, as is shown in the center in 
Fig. 104. 

The communication between the controller and the 
target model will now be described. 

(1) A user directs the controller 960 to a target mod- 
el (a copier 962). 

(2) The user touches a touch panel on the controller 
960 in order to determine the timing at which the 
controller 960 transmits a Ul request signal to the 
target model. Or, the controller 960 is set in advance 
to transmit a Ul request signal at a predetermined 
interval. 



10 



IS 



20 



25 



30 



35 



40 



45 



SO 



34 



67 



EP 0 851 384 A2 



68 



(3) The controller 960 transmits controller identifi- 
catbn data (controller A) to identify itself and a Ul 
request signal to the target model. 

(4) When the target model receives the controller 
Identification data and the U I request signal from the 5 
controller, the target model transmits, to the server 
1041 that manages the target model, the controller 
identification data (controller A) and target model 
identification data (copier) to identify itself, and re- 
quests the transmission of the Ul. io 

(5) The server 1041 transmits the Ul of the target 
model, which is indicated by the target model data, 
via a wireless LAN to the controller 960, which is 
indicated by the controller Identification data. 

(6) The controller 960 receives the Ul addressed to 
itself, and displays the Ul. 

Fig. 105 is a flowchart showing the processing per- 
formed by the controller 960 when the controller re- 
ceives a Ul via the wireless LAN, instead of directly re- 20 
ceiving it from a target model, and displays it. 

The processing performed by the controller 960 will 
now be described. At step S1051 the controller 960 
waits until an instruction from a user is input. At step 
SI 052 a Ul request signal for requesting a Ul and con- 25 
troller identification data for identifying a controller are 
transmitted to the target model by an infrared ray com- 
munication method. At step SI 053 the controller 960 
waits until a Ul signal is output by any device. At step 
SI 054, the received Ul is displayed, 30 

Fig. 106 is a flowchart showing the processing per- 
formed by the target model when the controller receives 
a Ul via the wireless LAN, instead of directly receiving 
it from a target model, and displays it. The processing 
performed by the controller 960 will now be described. 3S 

At step SI 061 the controller 960 waits until an in- 
struction from a user is input. At step SI 062 controller 
identification data received from the controller 960 and 
the target model identification data are transmitted to 
the server 1041, and issuance of the Ul is requested. 40 

Fig. 107 is a flowchart showing the processing per- 
formed by the server 1041 when the controller receives 
a Ul via the wireless LAN. instead of directly receiving 
it from a target model, and displays it. The processing 
performed by the server 1041 will now be described. 45 

At step S1 071 the server 1041 wails until a Ul trans- 
mission request signal is transmitted from the target 
model. At step 31072 the Ul of the model, which is in- 
dicated by the target model identification data. Is trans- 
mitted to the controller 960, which is indicated by iden- so 
tification data received from the target model. 

[Thirty-seventh Embodiment] 

Fig. 108 is a diagram showing an example where 55 
Uls of devices are stored in a wireless LAN server 1 041 

and when a controller 960a or 960b faces a facsimile 
machine 963 as a target model and requests a Ul, a dif- 



ferent Ul for each user is transmitted, upon a request 
from the facsimile machine 963, from the wireless LAN 
server 1041 to the controller 960a or 960b. and is dis- 
played. 

The controller 960a or 960b, which does not face a 
target device, has a default screen, as is shown in the 
center in Fig. 108. 

The communication between the user, the control- 
ler 960a or 960b and the target model will now be de- 
scribed. 

(1 ) A user directs the controller 960a or 960b to a 
target model. 

(2) The user touches a touch panel on the controller 
960a or 960b in order to determine the timing at 
which the controller 960a or 960b transmits a Ul re- 
quest signal to the target model. Or, the controller 
960a or 960b is set in advance to transmit a Ul re- 
quest signal at a predetermined interval. 

(3) The controller 960a or 960b transmits controller 
identification data (controller A or controller B) to 
identify itself, user identification data (a senior or a 
beginner) for identifying the user, and a Ul request 
signal to the target model. 

(4) When the target model receives, from the con- 
troller 960a or 960b, the controller identification da- 
ta, the user identification data and the Ul request 
signal, the target model transmits, to the server 
1041 that manages the target model, the received 
controller identification data, the user identification 
data and the target model identification data to iden- 
tify itself. 

(5) The server 1041 transmits the Ul of the target 
model, which is indicated by the user identification 
data and the target model data, via a wireless LAN 
to the controller 960a or 960b, which is indicated by 
the controller Identification data. In the example in 
Fig. 108, a Ul that is used for multi-address com- 
munication, which is difficult for beginners, is trans- 
mitted only to seniors, not to beginners. 

(6) The controller 960a or 960b receives the Ul ad- 
dressed to itself, and displays the Ul. 

In the above example, the controller transmits the 

level data for a user is transmitted as user identification 
data. However, the controller may transmit information, 
such as the names of users, to identify individual users, 
and the target device or the server may identify the level 
of a user from the received identification data. An inde- 
pendent Ul may be prepared for each user. 

The above example has been employed only for the 
Ul. The contents of urgent mail addressed to the user 
or the schedule to be immediately informed are collect- 
ed in, for example, the server, and they may be included 
in the Ul while the user identification data that differs 
among the users is referred to, and the resultant data 
can be transmitted to the controller. 

Fig. 1 09 is a flowchart showing the processing per- 
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formed by the controller 960 when the controller re- 
ceives a different Ul for each user, via the wireless LAN, 
Instead of directly receiving it from a target model, and 
displays it. The processing performed by the controller 
960 will now be described. 5 

At step S1 091 the controller 960a or 960b waits until 
an instruction from a user is input. At step S1092 a Ul 
request signal for requesting a Ul, controller identifica- 
tion data for identifying a controller, the user identifica- 
tion data for identifying the user are transmitted to the fo 
target model by an infrared ray communication method. 
At step S1093 the controller 960a or 960b waits until a 
Ul signal is output by any device. At step SI 094, the 
received Ul is displayed. 

Fig. 110 Is a flowchart showing the processing per- 
formed by the target model when the controller receives 
a different Ul for each user, via the wireless LAN. instead 
of directly receiving it from a target model, and displays 
It. The processing performed by the controller 960a or 
960b will now be described. 20 

At step S1 1 01 the controller 960a or 960b waits until 
an instruction from a user is input. At step S1102 the 
controller identification data received from the controller 
960, the user identification data, and the target model 
identification data are transmitted to the server 1041, 2S 
and the Issuance of the Ul is requested. 

Fig. 111 is a flowchart showing the processing per- 
formed by the server 1041 when the controller receives 
a different Ul for each user via the wireless LAN, instead 
of directly receiving it from a target model, and displays 30 
it. Fig. 112 is a table showing Uls that are determined 
by the target model and user identification data. The 
processing performed by the server 1041 will now be 
described. 

At step S11 11 the server 1041 waits until a Ul trans- 3S 
mission request signal is transmitted from the target 
model. At step S1112 in accordance with the definitions 
In Fig. 112, the U I that corresponds to the target model 
Identification data and the user identification data Is 
transmitted to the controller 960a or 960b, which is in- 40 
dicated by identification data received from the target 
model. 

[Thirty-eighth Embodiment] 

45 

Figs. 113 and 114 are diagrams illustrating an ex- 
ample where provided is a function that a model to be 
operated In front does not have. The communication be- 
tween a user, a controller and a target model will now 
be described. so 

(1) A user faces a controller 960 to a target model, 
and designated a desired function. 

(2) The target model receives a request from the 
controller 960 and transmits it to a server 1 041 . ss 

(3) The server 1041 transmits a Ul of a model that 
corresponds to the requested function. 

(4) The controller 960 displays a received Ul. 
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(5) The user performs operation according to an in- 
struction of the Ul. In this example, the user sets a 
document to be transmitted to a copier 962 in front, 
and the controller 960 Instructs the destination to 
execute the operation. 

(6) The target model handles what it can do and re- 
quests another apparatus to process what It can not 
do. In this case, since the copier 962 reads a doc- 
ument but can not facsimile the document, it trans- 
mits to a facsimile machine 963 the document data 
and the contents of the operation instruction. 

(7) The facsimile machine 963 transmits by fax the 
received document data to the instructed destina- 
tion. 

In the above example, to determine an apparatus 
that the copier 962 asks for the function that the copier 
962 can not perform, each apparatus may have knowl- 
edge for other apparatuses. Or, the apparatuses on the 
network may be queried if they can execute the function, 
and according to the result, the apparatus to be asked 
for may be determined. Or, an Inquiry may be issued to 
the server 1041 that has knowledge of the models that 
correspond to functions. 

[Thirty-ninth Embodiment] 

Fig. 1 1 5 is a diagram illustrating an example where, 
when a controller can . not directly communicate with a 
target model in front because an obstacle is present in 
route between the target model and the controller, indi- 
rect communication is attempted using another route. 

The communication between the user, the control- 
ler and the target model will now be described. It should 
be noted that (2) and (3) are not necessarily required. 
When, for example, in (4) a target model generates a 
signal to the controller at predetermined Intervals, the 
same effect can be obtained. In other wordS: only the 
essential portion is shown in Fig. 115. 

(1 ) A user directs the controller 960 to a target mod- 
el. 

(2) The user touches a touch panel on the controller 
960 in order to determine the timing at which the 
controller 960 transmits a Ui request signal to the 
target model. Or. the controller 960 is set In advance 
to transmit a Ul request signal at a predetermined 
interval. 

(3) The controller 960 transmits a Ul request signal 
to the target model. 

(4) A Ul signal Is transmitted upon the receipt of the 

Ul request signal from the controller 960, or accord- 
ing to the setup that a Ul request signal at a speci- 
fied Interval. 

(5) The controller 960 that receives the Ul signal dis- 
plays the Ul, 

(6) If a Ul is not transmitted following a predeter- 
mined period of time after the Ul request signal was 
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transmitted, or if a Ul is not transmitted during a pe- 
riod longer than a predetermined Interval, which is 
set for transmission of Uls. another route is em- 
ployed to transmit a Ul request signal. In this exam- 
ple, when infrared communication can not be per- s 
formed, communication through a wireless LAN is 
attempted. 

(7) The Ul acquired across the LAN is displayed. 



Fig. 11 6 is a flowchart showing the processing per- io 
formed by a controller for an example where, when the 
controller can not directly communicate with a target 
model in front because an obstacle is present in route 
between the target model and the controller, indirect 
communication Is attempted using another route. The 
processing performed by the controller 960 will now be 
described. 

At step S1161 the controller 960 waits until an in- 
struction from a user is input. At step S1162 aUI request 
signal for requesting a Ul and controller identification da- 20 
ta for identifying a controller are transmitted to the target 
model by an Infrared ray communication method. At 
step S 11 63 a check is performed to determine whether 
or not the Ul has been received. At step S1 1 64 a check 
is performed to determine whether a predetermined pe- 25 
riod of time has elapsed following the transmission of 
the request. At step S1165 a Ul request signal, for re- 
questing a Ul. and controller Identification data, for iden- 
tifying a controller, are transmitted by a route, such as 
across a wireless LAN, that is different from the route at 30 
step S1162. At step S1166 the received Ul is displayed. 

In this case, the Ul request signal that is directly 
transmitted to the target model is to be sent to the wire- 
less LAN server 1 041 . However, since the wireless LAN 
server 1041 that receives the Ul request signal is not 3S 
sure of a target model, first a menu for selecting a model 
(function) is displayed. AUI corresponding to the select- 
ed model is displayed. Upon receipt of the model selec- 
tion signal from the controller 960, the wireless LAN 
server 1041 may transmit to the controller 960 a Ul that 40 
corresponds to the model, or may transmit the menu and 
a plurality of Uls available from the menu. 

[Fortieth Embodiment] 

45 

Fig. 117 is a diagram showing an example where 
an operation and an action performed by a user, the time 
and associated Important Information are stored as his- 
tory. 

An explanation will be given for the processing for 50 
storing, as history, the operation/action performed by 
the user, the time and the associated important informa- 
tion. 

(1 ) A user sets a document in a facsimile machine 5S 
963, and instructs the transmission of the document 
and the user's name (sender's name) to Mr a of A 
company. 



(2) According to the instruction, the facsimile ma- 
chine 963 transmits the document to Mr a. Also ac- 
cording to the instruction from Tom, the facsimile 
machine 963 notifies the server 1041 of the fact that 
the document has been transmitted to Mr. a togeth- 
er with the transmitted document and the transmis- 
sion time. 

(3) The server 1041 saves the received document 
as a file "File ABC and stores the fact of the receipt 
as history Information. 

Fig. 118 is a flowchart showing the processing per- 
formed by the controller for an example where an oper- 
ation and an action performed by a user, the time and 
the associated important information are stored as his- 
tory data. The processing performed by the controller 
will now be described. 

At step S1 181 the controller 960 waits until an in- 
struction from a user is input. At step 81182 a request 
signal, for the instruction of the user, controller identifi- 
cation data, for identifying a controller, and the user 
identification data, for identifying the user, are transmit- 
ted by an infrared ray communication method. At step 
S1183 the controller 960 waits until a Ul signal is output 
by any device. At step S1 184, the received Ul is dis- 
played. 

Fig. 1 1 9 Is a flowchart showing the processing per- 
formed by the target model for an example where an 
operation and an action performed by a user the time 
and the associated Important information are stored as 
history data. The processing performed by the target 
model will now be described. 

At step S1 1 91 the target model waits until a request 
signal is transmitted by the controller 960. At step S1 1 92 
a process corresponding to the request signal from the 
controller 960 Is performed. In the example shown in 
Fig. 117 a document set by the user is read and trans- 
mitted to Mr a of A company. At step S1 193 controller 
identification data received from the controller 960, the 
user identification data, and target model identification 
data, and important data associated with the action that 
was performed, are transmitted to the server 1401. In 
the example in Fig. 117, according to the instruction from 
Tom, the fact that the document was transmitted to Mr 
a is sent to the server 1041 , together with the transmis- 
sion lime and the transmitted document that is the im- 
portant information associated with the fact. 

Fig. 1 20 is a flowchart showing the processing per- 
formed by the server for an example where an operation 
and an action performed by a user, the time and the as- 
sociated important information are stored as history da- 
ta. Fig. 121 is a diagram showing example history infor- 
mation that is updated as the result of processing. The 
processing performed by the server will now be de- 
scribed. 

At step SI 201 the server waits until it receives a 
request signal from the target model. At step S1 202 the 
important information associated with the received fact 
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is stored. In the example in Fig. 117 the document the 
transmission of which is Instructed by Tom Is saved as 
File ABC. 

At step S1203 the history data are updated in con- 
sonance with the received fact. In the example shown s 
in Fig. 117 the fact that Tom transmitted a document to 
M. a of A company at 1 0:00 on July 5, 1 996 Is recorded 
together with the file name stored at step S1201. Fig. 
121 is a table showing updated history data; the fact that 
Mary printed ten copies of File XYZ on July 3, 1 996, and io 
the fact that Tom transmitted File ABC to Mr. a of A com- 
pany at 1 0:00 on July 5, 1 996. At step S1 204 a Ul that 
indicates the normal termination of the processing is 
transmitted to the controller that is defined by the con- 
troller identification data received from the target model, 

[Forty-first Embodiment] 

Figs. 122 and 123 are diagrams showing an exam- 
ple where an operation/action performed by a user, the 20 
time and associated important information are stored as 
history data and based on the history data an operation 
is performed. 

An explanation will be described the processing for 
the example where an operation/action performed by a 25 
user, the time and associated important information are 
stored as history data and based on the history data an 
operation Is performed. 

(1 ) A controller 960 instructs a copier 962 to show 30 
the history of Tom. 

(2) Upon receipt of the instruction, the copier 962 
asks a server 1 40 1 for managing the history to show 
the history of Tom. 

(3) The server 1041 refers to the history data and 35 
transmits, as a Ul, only the history associated with 
the Tom to the copier 962. The copier 962 transmits 

the received history data to the controller 960. 

(4) Tom selects a specific fact from the history data 
displayed on Ihe controller 960, and instructs an ac- 40 
tion. In this case, since Tom needs a material that 
was previously sent to A company, the fact "File 
ABC was sent to Mr. a of A company" is selected 
and action "copy" is instructed to acquire the mate- 
rial from the copier 962 in front. 45 

(5) The copier 962 transmits to the server 1 041 the 
instruction "copy File ABC" from the user. 

(6) The server 1041 sends a corresponding docu- 
ment "File ABC" to the copier 962. 

(7) The copier 962 prints a document received by so 
the server 1041. 

In the above example, the fact "File ABC was sent 
to Mr. a of A company" is selected from the history in 
order to acquire necessary material from the copier 962 55 
in front. When the name of document "File ABC" to be 
output is obtained, the list of files can be displayed in- 
stead of the history data and the file name can be se- 



lected, or the file name can be input directly. 

In addition, in the above example, the document to 
be extracted is the one that is transmitted by the facsim- 
ile machine 963 and stored in the sen/er 1041 . A docu- 
ment stored in a PC across the network can also be em- 
ployed. 

Fig. 124 is a diagram showing the structure of the 
controller 960 used in this embodiment. 

A display 1241 is used to display data on a liquid 
crystal screen. A resistance film Is attached to the dis- 
play 1241, and data can be Input with a pen 1242. A 
button on a screen may be selected by the pen 1242. 
Furthermore, a character recognition function is provid- 
ed, and the characters written with the pen 1242 can be 
input. Instead of this function, a voice input/recognition 
function may be employed to input information. 

The input information can be transmitted from a 
communication unit 1243 to another apparatus. A CPU 

1244 for controlling and a storage unit 1245 are provided 
inside the apparatus, and input information and informa- 
tion received by the communication unit 1243 and the 
history of the operations are stored. The storage unit 

1245 can be a SRAM card, an SIMM or an HDD. The 
controller 960 is battery operated and water resistant. 

Fig. 125 is a diagram illustrating another example 
structure of the controller 960 used in the embodiment. 

A display 1251 is used to display data using liquid 
crystal or a CRT A touch panel can be additionally pro- 
vided as an option to the display 1 251 . Thus, information 
can be input by a finger or a pen. An input unit 1252 is 
used to input information by manipulation of a button. 
The input data can be transmitted from a communication 
unit 1253 to another apparatus. A CPU 1254 for control- 
ling and a storage unit 1255 are provided inside the ap- 
paratus, and input information and information received 
by the communication unit 1253 and the history of the 
operations are stored. The storage unit 1255 can be a 
SRAM card, an SIMM or an HDD. 

The controller in Fig. 125 can be used as a button 
controller with the storage unit 1 255 being removed. The 
controller can be used as a personal digital assistant 
(PC) with the communication unit 1253 being removed. 
In addition, the controller can be used as is shown in 
Fig. 124, with the input unit 1252 being removed and 
with the touch panel provided. 

Fig. 126 is a diagram showing an additional exam- 
ple structure of the controller 960 used in this embodi- 
ment. 

A display 1261 is used to display data using liquid 
crystal. An input unit 1262 is used to input information 
by manipulating a button. The input data can be trans- 
mitted by an infrared communication unit 1 263 to anoth- 
er apparatus. A CPU 1264 for controlling and a storage 
unit 1265 are provided inside the apparatus, and input 
information and information received by the infrared 
communication unit 1 263 and the history of the opera- 
tions are stored. The storage unit 1 265 can be a SRAM 
card, an SI MM or an HDD. Furthermore, a PCMCIA slot 
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1266 is provided, and, for example, a PCMCIA card is 
loaded into the slot 1 266 to enable the connection by a 
PCMCIA bus. so that two communication channels can 
be employed. The infrared communication unit 1263 
may be used only for transmission by light emission, and s 
the PCMCIA bus may be used for reception. Of course, 
the connection by the PCMCIA bus may not be em- 
ployed. 

[Forty-second Embodiment] io 

This system arrangement according to this embod- 
iment is as shown In Figs. 41 A and 41 B, and information 
processing apparatuses 411, 412 and 413 can commu- 
nicate with each other is 

When the information processing apparatus 411 
needs information stored in the information processing 
apparatus 412, or when the information is to be trans- 
mitted to the information processing apparatus, or when 
an instruction is to be transmitted to the information 20 
processing apparatus 412, the information processing 
apparatus 411 requests the communication with the in- 
formation processing apparatus 412 and exchanges re- 
quired information and an instruction. 

Any apparatus can be used for the information 25 
processing apparatuses 41 1 , 41 2 or 41 3 so long as they 
have necessary communication function; a printer, a 
scanner, a facsimile machine, a desktop PC or a digital 
camera can be used. 

Fig. 127 is a diagram illustrating the functional ar- 30 
rangement for this embodiment. 

An operating unit 41 displays a screen required for 
a user to operate in accordance with data stored in an 
operation data memory area 42. An operation per- 
formed by a user or an instruction issued by a user is 3S 
acquired by the operation unit 41 and transmitted to a 
task reception unit 43. 

The operation data 42 is data to be referred to by 
the operation unit 41, and specifies the process at the 
operation unit 41. in this embodiment, based on the in- 40 
formation received by the task reception unit 43, the op- 
eration data 42 is altered or updated by a process exe- 
cution unit 47, which will be described later, so that flex- 
ible procedures can be provided. 

One of methods for operating an apparatus other 4S 
than the information processing unit 411, i.e., the infor- 
mation processing apparatus 412, is the one for acquir- 
ing the operation data 42 for the information processing 
apparatus 412 and for altering and updating the opera- 
tion data 42 of the information processing apparatus so 
411. 

In another example, the presence of the information 
processing apparatus 412, which is connected across 
the network to the information processing apparatus 411 
in this embodiment, is detected, so that a new function ss 
obtained by combining the two information processing 
apparatuses can be implemented. Information required 
for an Instruction for the function is added to the opera- 
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tion data 42, and thus, the function obtained by combin- 
ing a plurality of apparatuses can be provided. 

The task reception unit 43 receives not only infor- 
mation from the operation unit 41 , but also receives, as 
the status change, a change in the environment of the 
information processing apparatus 41 1 or a task received 
from another apparatus, such as the information 
processing apparatus 412. Task reception unit 43 also 
detects the connection of a new information processing 
apparatus to the network, receives as a task a print in- 
struction from another apparatus, or detects that no 
process is performed during a specified period of time. 
As a result, received information is added as a new task 
to a task table 44. 

The task reception unit 43 is required as well as the 
process execution unit 47, which will be described later, 
to communicate with different apparatuses. 

The task table 44 is a table in which are stored tasks 
having the activation condition and the contents. Figs. 
1 29A to 1 29F are examples for the task table 44. 

In Figs. 1 29A to 1 29F, the tasks are stored from the 
top of the table in the order of priorities. The addition of 
a task to the task table 44 is performed by the previously 
mentioned task reception unit 43 and the process exe- 
cution unit 47 to be described later Extraction of the task 
from the task table 44 is performed by a task analysis 
unit 45, which will be described later 

The task analysis unit 45 extracts a task having the 
highest priority from the task table 44, and analyzes the 
object of the task. Since the task analysis unit 45 ana- 
lyzes the object, a planning decision unit 46 and the 
process execution unit 47 can avoid inefficient process- 
ing and can perform an optimal process. 

For example, a task 63 in the task table 44 in Figs. 
1 29 A to 1 29F is analyzed and understood that the direct 
object is printing and the final object is to transmit a print- 
ed document to a user. If the final object can be achieved 
by an efficient method, it is found that even printing Is 
unnecessary, and planning is performed according to 
that effect. The information to be processed is also an- 
alyzed, and it is found that format conversion is required. 

The planning decision unit 46 receives the analysis 
from the task analysis unit 45, makes planning for a 
process to be performed. For example, for the task 63 
stored in the task table 44 in Figs. 1 29A to 1 29F, a proc- 
ess for extracting an object from an apparatus B before 
printing of the object is planned. 

The process execution unit 47 performs a process 
according to the contents determined by the planning 
decision unit 46, e.g., sends an instruction to another 
apparatus. The process execution unit 47 will be de- 
scribed in detail in a forty-third embodiment and follow- 
ing embodiments. The functional arrangement in Fig. 
1 27 can be provided by the hardware configuration in 
Fig. 3. 

Fig. 128 is a flowchart showing the processing for 
this embodiment. 

When the information processing apparatus 411 in 
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this embodiment is activated, at step S51 the task table 
44 Is initialized as is denoted by 61 in Fig. 129A. 

Then, at step S52 a check is performed to deter- 
mine whether the task reception unit 43 has received, 
as the status change, information that Is acquired by the 
operation unit 41 for an operation Instruction from a user, 
an environmental change, or a task from another appa- 
ratus. When the task is received, program control ad- 
vances to step S53, and as is shown in Fig. 129B, the 
analysis task 62 of the received information is added to 
the head of the task table 44. 

Following this, at step S54 a check Is performed to 
determine whether or not an executable task is present 
in the task table 44. If there is no such task, program 
control returns to step S52, whereat the reception of the 
task is examined again. If there is such a task, program 
control moves to step S55, whereat the task having the 
highest priority is extracted from the task table 44. 

At step S56 the object of the task is analyzed, and 
at step S57 the process to be performed Is planned and 
decided. If the task table is in the state shown in Fig. 
129B, highest priority task 62 "ANALYZE" is extracted, 
it is apprehended that its object is analysis of received 
information, and planning for analysis Is performed. 

At step S58 the process according to the planning 
is performed, and as needed, a new task is added to the 
task table 44. When, for example, the received informa- 
tion is analyzed according to the plan obtained from the 
task 62 "ANALYZE" in Fig. 129B. the contents "Print 
'contract, doc' from B' which is instructed by a user 
through the operation unit 41, are analyzed and a new 
task 63 "PRINT" is added as is shown in Fig. 129C. 

Program control returns again to step S52. Howev- 
er, since no new task is received, program control 
moves to step S54. and the above process is repeated. 
As a result, task 63 "PRINT" in Fig. 129C, which was 
added at step S58, is extracted, analyzed and planned. 
To execute task PRINT, it is found that the object must 
be present In the information processing apparatus 41 1 , 
and new task 64 "PULL" and task 65 "PRI NT" which em- 
ploys the "pulled" object, are added as is shown in Fig. 
129D. 

In addition, when the processing is repeated, the 
task 64 "PULL" in Fig. 129D is executed. Since the con- 
tents of the task PULL are important portions for the 
present invention, detailed explanation for them will be 
given tor the forty-third embodiment and the following. 

When the process is further repeated, the object 
that is acquired as the result of the task PULL is em- 
ployed to perform task 65 in Fig. 129E. As a result, the 
task table 44 is returned to the initial state, as is shown 
in Fig. 129R 

[Forty-third Embodiment] 

Fig. 130 is a d'iagrarr\ showing an example input/ 
output device that can operate another apparatus. 
The operation procedure (Ul) implemented by the 



operation unit 41 is performed by referring to the oper- 
ation data 42 that the information processing apparatus 
411 originally includes, or by referring to the operation 
data 42 that is acquired from another information 
5 processing apparatus 41 2 connected to the network. 

An instruction 71 by a user's voice, or the employ- 
ment of an operation panel screen 72 to designate a tar- 
get device, is performed by referring to the operation da- 
ta 42 that are originally included in a copier, which 
10 serves as the information processing apparatus 411 . 

The copier 74, which is the information processing 
apparatus 411 , executes the task PULL at the process 
execution unit 47.. and refers to on the operation data 
42, which are acquired from a facsimile machine 75 that 
is serves as the information processing apparatus 412 
connected via the network, to designate a transfer des- 
tination and a condition by using the screen 73 of the 
operation panel. 

The operation data 42 of the facsimile machine 75 
may be held by the copier 74 in advance, and be referred 
to as needed. 

The operation data 42 of the facsimile machine 75 
may be acquired from another device, such as a server 
A specific method for communication between the 
information processing apparatuses 41 1 and 412 will be 
explained in detail for a forty-ninth embodiment and the 
following embodiments. 

[Forty-fourth Embodiment] 

Fig. 131 is a diagram showing an input/output ap- 
paratus that can operate a function obtained by a com- 
bination of a plurality of devices. 

The procedure (Ul: User Interface) implemented by 
the operation unit 41 is performed by referring to the op- 
eration data 42 the Information processing apparatus 
411 originally Includes, or by referring to the operation 
data 42 that is updated as the result of the detection of 
the information processing apparatus 412 connected 
via the network. 

The number of copies using the operation panel 81 
in Fig. 1 31 is designated by referring to the operation 
data 42 that is originally included in the copier 74, which 
serves as the information processing apparatus 411. 
The "Copy" displayed in the lower portion of the opera- 
lion panel indicates an instruction of copying, and 
"transmit" displayed in the hatched state Indicates that 
the transmission process is disabled. 

As the result of the detection of the facsimile ma- 
chine 75. which serves as the information processing 
apparatus 41 2 connected via the network, the operation 
data 42 of the copier 74 are updated to the function that 
can be used, i.e., the transmission function from which 
the hatching is removed, and is referred to, so that the 
number of copies on a display 82 is designated using 
the operation panel, as well as the operation panel 81. 

When a user selects and instructs the execution of 
the transmission function, a display 83 for designating 
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the transmission destination is provided and the trans- 
mission function can be executed. As is described 
above, when a user need only set a desired document 
on a copier near the user and instruct the execution of 
the transmission function, the document can be trans- 
mitted by using the function of the facsimile machine 75, 
which is at a remote area and is connected via a net- 
work. This accomplishes both the document input func- 
tion of the copier and the document transmission func- 
tion of the facsimile machine. 

When the facsimile machine 75 is not connected on 
the display 81 , the transmission operation on the display 
83 for designating the transmission destination is per- 
formed in advance, and at the same lime that the con- 
nection of the facsimile machine 75 is detected, the con- 
tents of the transmission operation is transmitted to the 
facsimile machine 75. Thus, in consonance with the 
contents, the automatic transmission can be performed, 
or the reservation operation, such as a confirmation to 
a user before automatic transmission, as is shown in a 
screen 84, can be performed. 

In this embodiment, while the facsimile machine 75 
is not connected, the display "transmit" for a transmis- 
sion instruction is displayed by hatching to indicate 
transmission is enabled. Such a display may not be pro- 
vided at all. 

A specific method for communication between the 
information processing apparatuses 41 1 and 41 2 will be 
described in detail for the forty-ninth embodiment and 
the folbwing. 

[Forty-fifth Embodiment] 

Fig. 132 is a diagram Illustrating an example input/ 
output device that can communicate with a user. 

In the example in Fig. 1 32, a user sends an instruc- 
tion 93 to a copier 91 that is physically located in a re- 
mote area In order to permit a MyDesk 92. a desktop 
personal computer, to display the current location of the 
user. 

The instruction 93 "Display present place on 
<IVIyDesk>", which is sent to the copier 91 that serves 
as the information processing apparatus 411, is trans- 
mitted from the operation unit 41 to the task reception 
unit 43. The contents are analyzed and planning is per- 
formed on the results. Then, the execution unit 47 exe- 
cutes the final data as an instruction task INDICATE for 
a PC 92, which serves as the information processing 
apparatus 412 connected via the network. 

The PC 92. which is the information processing ap- 
paratus 41 2 connected via the network, receives com- 
munication task COMMUNICATION from the reception 
unit 43, analyzes a received instruction, and perform 
planning on the results. Then, the execution unit 47 dis- 
plays a message on a screen. 

A specific method for communication between the 
information processing apparatuses 41 1 and 412 will be 
described in detail for the forty-ninth embodiment and 



the following. 

[Forty-sixth Embodiment] 

5 Fig. 1 33 is a diagram illustrating an example input/ 
output device that can acquire information from another 

apparatus. 

In the example in Fig. 1 33, a user sends an instruc- 
tion 1 333 to a printer 1 331 that is located in a physically 

10 remote area to print information 1 334 "contract.doc" that 
is stored in apparatus B1 332. 

The instruction 1333 "Please fetch 'contract.doc' 
from B and print it" which the user sent to the printer 
1 331 that serves as the information processing appara- 

is tus 411 , is transmitted from the operation unit 41 to the 
task reception unit 43. The contents are analyzed and 
planning is performed on the results. Then, the execu- 
tion unit 47 executes the final data as information acqui- 
sition task PULL for the apparatus B 1 332, which serves 

20 as the information processing apparatus 412 connected 
via the network. The apparatus B can be a printer, a 
scanner, a desktop PC or a filing server. 

The apparatus B1 332, which sen/es as the informa- 
tion processing apparatus 41 2 connected via the net- 

25 work, receives the information acquisition task PULL 
from the reception unit 43, analyzes the received In- 
struction, and performs planning on the data. The exe- 
cution unit 47 then transmits corresponding information 
1334 "contract. doc". 

30 A specific method for communication between the 
information processing apparatuses 41 1 and 41 2 will be 
described in detail for the forty-ninth embodiment and 
the following. 

3S [Forty-seventh Embodiment] 

Fig. 1 34 is a diagram illustrating an example input/ 
output device that can be stored in another apparatus. 
In the example shown in Fig. 134, a user reads a 

40 document 115 using a scanner 111 and sends an In- 
struction 1 1 3 to permit a filing server 1 1 2 at a physically 
remote area to perform filing with a title and an index. 

The instruction 113 "Filing to Filing Server, Title. In- 
dex Extraction" which the user sent to the scanner 111 

45 that serves as the information processing apparatus 
411 , Is transmitted from the operation unit 41 to the task 
reception unit 43. The contents are analyzed and plan- 
ning is performed on the results. Then, the execution 
unit 47 executes the final data as information storage 

50 task PUSH for the filing server 1 1 2, which serves as the 
information processing apparatus 412 connected via 
the network. 

The filing server 112, which serves as the informa- 
tion processing apparatus 41 2 connected via the net- 
ss work, receives the information storage task PUSH from 
the reception unit 43, analyzes the received instruction, 
and performs planning on the data. The execution unit 
47 then files corresponding information 115 "contract. 
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doc". 

A specific method for communication between the 
information processing apparatuses 411 and 41 2 will be 
described in detail for the forty-ninth embodiment and 
the foltowing. s 

[Forty-eighth Embodiment] 

Fig. 135 Is a diagram illustrating an example Input/ 
output device that can be stored in another apparatus. io 

In the example shown In Fig. 135, a user sends an 
instruction 123 to a printer 121 to transmit information 
125, which is stored in a filing server 122 located at a 
physically remote area, to John 124 who Is located at a 
physically farther area. is 

The instruction 123 "Action: SEND, What: abc.doc, 
From: Filing Server, To: John" which the user sent to the . 
printer 121 that serves as the information processing ap- 
paratus 411, is transmitted from the operation unit 41 to 
the task reception unit 43. The contents are analyzed 20 
and planning is performed on the results. Then, the ex- 
ecution unit 47 executes the final data as an instruction 
task for the filing server 122. which serves as the infor- 
mation processing apparatus 41 2 connected via the net- 
work. 25 

The filing server 122, which serves as the informa- 
tion processing apparatus 41 2 connected via the net- 
work, receives the instruction task from the reception 
unit 43, analyzes the received instruction, and performs 
planning on the data. The execution unit 47 then trans- 30 
mits corresponding information 125 "abc.doc" to John 
by E-mail. 

A specific method for communication between the 
information processing apparatuses 411 and 412 will be 
described in detail for the forty-ninth embodiment and 3S 
the following. 

[Forty-ninth Embodiment] 

Figs. 136A and 136B are flowcharts showing the 40 
processing for <COMMUNICATE> task. 

<COMMUNICATE> task is performed when arbi- 
trary apparatuses A and B need communicate with each 
other. In Figs. 1 36A and 1 36B are shown the processing 
that the apparatus A (a source) that transmits a COM- 
MUNICATE request is to execute for communication 
with the apparatus B (destination) that receives a COM- 
MUNICATE request. 

At step S1312, the apparatus A contacts the appa- 
ratus B to establish the connection for communication, so 
At step SI 31 3 a check is performed to determine where 
a reply is received from the apparatus B. If there is no 
response from the apparatus B, at step SI 31 4 a check 
is performed to determine whether or not a user or an- 
other person should be notified of no response. If noti- ss 
fication is necessary, at step S1315 a notification is Is- 
sued to a user by an appropriate means/medium. At 
step 31316, according to the decision/assumption of the 



system or the setup by the user, a check is performed 
to determine whether the task should be re-execute by 
the system later. If the re-execution of the task is nec- 
essary, at step 81317 the task is added to the task table, 
and the processing is thereafter terminated. If the re- 
execution of the task is not required, at step 81318 the 
task is deleted, and is added to "failed list". The process- 
ing is thereafter terminated. 

When, at step 81 31 3, a response Is received, at 
step S1319 whether the response is "WIN call back" is 
determined. If the response is "Will call back" the appa- 
ratus B will call back the apparatus A later. At step 
SI 320, a check is performed to determine whether or 
not the user or another person should be notified of the 
response. If notification Is necessary, at step 81 321 the 
notification is issued to the user by an appropriate 
means/medium. At step 81 322 the system adds the lask 
to the task table, and remembers that the apparatus B 
will call back so as to cope with the call back. The 
processing is thereafter terminated. 

If, at step 81 31 9, the response is not "Will call back" 
at step SI 323 whether the response is "Contact later" 
is determined. If the response is "Contact later" it is as- 
sumed that the apparatus B wants a contact later and 
the above described processes at step Si 31 4 and the 
following steps are performed. When, at step S1 323, the 
response is not "Contact later" it is assumed that the 
response Is "OK" and at step SI 324 the response is con- 
firmed. If the response Is not "OK" an error occurs. At 
step 81 331 an error message is displayed. 

When the response is "OK" at step SI 325 a check 
is performed to determine whether or not a negotiation 
with the apparatus B is required for the current opera- 
tion. If the negotiation is required, at step SI 326 a ne- 
gotiation Is initiated. The object to be negotiated in- 
cludes a data format for data execute and protocol/ver- 
sion exchange, and a data format for other Information 
required in advance for correct communication. This ne- 
gotiation is repeated until the communication base used 
in common for the apparatuses A and B is established. 

At step 81327 Information to be transmitted is is- 
sued as an request from the apparatus A to the appa- 
ratus B. At step 81328, whether or not a response is 
received. When the response Is received, at step 81 329 
a check is performed to determine whether there Is an 
action to be executed relative to the received response. 
The action Is, for example, conversion of a format or 
erasure of an unnecessary header. The object of the 
communication Includes actions such as printing, trans- 
mission, filing, voice output and display. This means that 
necessary actions should be executed, and at step 
SI 330 these actions are added to the task table. 

When, at step SI 328, there is no response, the 
above described processes at step 81314 and the fol- 
lowing steps are performed. The above processing loop 
is continued until requested Information is obtained or 
until the system can not continue the processing. 
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[Fiftieth Embodiment) 

Figs. 137A and 137B are flowcharts showing the 
processing for <PULL> task. 

<PULL> task is performed when an arbitrary appa- s 
rat us A needs to extract information from an apparatus 
B. In Figs. 137A and 1378 are shown the processing 
that the apparatus A (a source) that transmits a PULL 
request is to execute for communication with the appa- 
ratus B (destination) that receives a PULL request. io 

At step S1412, the apparatus A contacts the appa- 
ratus B to establish the connection for communication. 
At step S141 3 a check is performed to determine where 
a reply is received from the apparatus B. If there is no 
response from the apparatus B, at step SI 41 4 a check is 
is performed to determine whether or not a user or an- 
other person shoukJ be notified of no response. If noti- 
fication is necessary, at step SI 41 5 a notification is is- 
sued to a user by an appropriate means/medium. At 
step 81 41 6, according to the decision/assumption of the 20 
system or the setup by the user, a check is performed 
to determine whether the task should be re-execute by 
the system later. If the re-executlon of the task is nec- 
essary, at step S 1 41 7 the task is added to the task table, 
and the processing is thereafter terminated. If the re- 25 
execution of the task is not required, at step 31418 the 
task is deleted, and is added to "failed list". The process- 
ing is thereafter terminated. 

When, at step S1413, a response is received, at 
step SI 41 9 whether the response is "Will call back" is 30 
determined. If the response is "Will call back" the appa- 
ratus B will call back the apparatus A later At step 
SI 420, a check is performed to determine whether or 
not the user or another person should be notified of the 
response. If notification is necessary, at step SI 421 the 3S 
notification is issued to the user by an appropriate 
means/medium. At step SI 422 the system adds the task 
to the task table, and remembers that the apparatus B 
will call back so as to cope with the call back. The 
processing is thereafter terminated. 40 

If, at step 31 41 9, the response is not "Will call back" 
at step S1423 whether the response is "Contact later" 
is determined. If the response is "Contact later" it is as- 
sumed that the apparatus B wants a contact later, and 
the above described processes at step 81 41 4 and the 45 
following steps are performed. When, at step 81423. the 
response is not "Contact later" it is assumed that the 
response is "OK" and at step SI 424 the response is con- 
firmed. If the response is not "OK" an error occurs. At 
step S1431 an error message is displayed. so 

When the response Is "OK" at step SI 425 a check 
is performed to determine whether or not a negotiation 
with the apparatus B is required for the current opera- 
tion. If the negotiation is required, at step SI 426 a ne- 
gotiation is initiated. The object to be negotiated in- 55 
eludes a data format for data execute and protocolA/er- 
sion exchange, and a data format for other information 
required in advance for correct communication. This ne- 



gotiation is repeated until the communication base used 
in common for the apparatuses A and B is established. 

At step SI 427 information to be extracted is issued 
as a request from the apparatus A to the apparatus B. 
At step 81428, whether or not requested information is 
received. When the requested information is received, 
at step SI 429 a check is performed to determine wheth- 
er there is an action to be executed relative to the re- 
ceived response. The action is, for example, conversion 
of a format or erasure of an unnecessary header. The 
object of the extraction of information includes actions 
such as printing, transmission, filing, voice output and 
display. This means that necessary actions should be 
executed, and at step S1430 these actions are added 
to the task table. 

When, at step SI 428, requested information is not 
acquired, the above described processes at step 81 414 
and the following steps are performed. The above 
processing loop is continued until requested Information 
is obtained or until the system can not continue the 
processing. 

[Fifty-first Embodiment] 

Figs. 138A and 138B are flowcharts showing the 
processing for <PUSH> task. 

<PUSH> task is performed when an arbitrary appa- 
ratus A need to transmit Information to an apparatus B. 
In Figs, 138A and 1 38B are shown the processing that 
the apparatus A (a source) that transmits a PUSH re- 
quest Is to execute for communication with the appara- 
tus B (destination) that receives a PUSH request. 

At step SI 51 2. the apparatus A contacts the appa- 
ratus B to establish the connection for communication. 
At step SI 5 1 3 a check is performed to determine where 
a reply is received from the apparatus B. If there is no 
response from the apparatus B, at step SI 51 4 a check 
is performed to determine whether or not a user or an- 
other person should be notified of no response. If noti- 
fication is necessary, at step 81 51 5 a notification is is- 
sued to a user by an appropriate means/medium. At 
step S 1 51 6, according to the decision/assumption of the 
system or the setup by the user, a check is performed 
to determine whether the task should be re-execute by 
the system later. It the re-execution of the task is nec- 
essary, at step 81517 the task is added to the task table, 
and the processing is thereafter terminated. If the re- 
execution of the task is not required, at step 81 51 8 the 
task is deleted, and is added to "failed list". The process- 
ing is thereafter terminated. 

When, at step 81513, a response is received, at 
step 81519 whether the response is "Will call back" is 
determined. If the response is "Will call back" the appa- 
ratus B will call back the apparatus A later. At step 
81 520, a check is performed to determine whether or 
not the user or another person should be notified of the 
response. If notification is necessary, at step 81521 the 
notification is issued to the user by an appropriate 



43 



85 



EP 0 851 384 A2 



86 



means/medium. At step SI 522 the system adds the task 
to the task table, and remembers that the apparatus B 
will call back so as to cope with the call back. The 
processing is thereafter terminated. 

If. at step S1519. the response is not "Will call back" 
at step SI 523 whether the response is "Contact later" 
is determined. If the response is "Contact later" it is as- 
sumed that the apparatus B wants a contact later, and 
the above described processes at step S1514 and the 
following steps are performed. When, at step S1 523, the 
response is not "Contact later* it is assumed that the 
response is "OK" and at step SI 524 the response is con- 
firmed. If the response is not "OK" an error occurs. At 
step SI 531 an error message is displayed. 

When the response is 'OK" at step 81 525 a check 
Is performed to determine whether or not a negotiation 
with the apparatus B is required for the current opera- 
tion. If the negotiation is required, at step S1526 a ne- 
gotiation is initiated. The object to be negotiated in- 
cludes a data format for data execute and protocol/ver- 
sion exchange, and a data format for other information 
required in advance for correct communication. This ne- 
gotiation is repeated until the communication base used 
in common for the apparatuses A and B is established. 

At step SI 527 information to be transmitted is is- 
sued as a request from the apparatus A to the apparatus 
B. At step S1 528, whether or not a response is received. 
When the response Is received, at step SI 529 a check 
is performed to determine whether there is an action to 
be executed relative to the received response. The ac- 
tion is, for example, conversion o1 a format or erasure 
of an unnecessary header. The object of the communi- 
cation includes actions such as printing, transmission, 
filing, voice output and display. This means that neces- 
sary actions should be executed, and at step 81530 
these actions are added to the task table. 

When, at step 81528. there is no response, the 
above described processes at step S1514 and the fol- 
lowing steps are performed. The above processing loop 
is continued until requested information is obtained or 
until the system can not continue the processing. 

[Fifty-second Embodiment] 

Figs. 139A and 139B are flowcharts showing the 
processing for <fNDICATE> task. 

<INDICATE> task is performed when an arbitrary 
apparatus A needs to send an instruction to an appara- 
tus B. In Figs. 1 39 A and 1 39B are shown the processing 
that the apparatus A (a source) that transmits an INDI- 
CATE request is to execute for communication with the 
apparatus B (destination) that receives an INDICATE re- 
quest. 

At step 81612, the apparatus A contacts the appa- 
ratus B to establish the connection for communication. 
At step SI 61 3 a check is performed to determine where 
a reply is received from the apparatus B. If there is no 
response from the apparatus B, at step SI 61 4 a check 



Is performed to determine whether or not a user or an- 
other person should be notified of no response. If noti- 
fication is necessary, at step 81615 a notification is is- 
sued to a user by an appropriate means/medium. At 

5 step 81 61 6. accordingtothe decision/assumption of the 
system or the setup by the user, a check is performed 
to determine whether the task should be re-execute by 
the system later. If the re-execution of the task is nec- 
essary, at step 81 61 7 the task is added to the task table, 

10 and the processing is thereafter terminated. If the re- 
execution of the task is not required, at step 81618 the 
task is deleted, and is added to "failed list". The process- 
ing is thereafter terminated. 

When, at step S1613, a response is received, at 

IS step 81619 whether the response is "Will call back" is 
determined. If the response is "Will call back" the appa- 
ratus B will call back the apparatus A later. At step 
81 620, a check is performed to determine whether or 
not the user or another person should be notified of the 

20 response. If notification is necessary, at step SI 621 the 
notification is issued to the user by an appropriate 
means/medium. At step S 1 622 the system adds the task 
to the task table, and remembers that the apparatus 8 
will call back so as to cope with the call back. The 

25 processing is thereafter terminated. 

If, at step SI 61 9. the response is not "Will call back' 
at step SI 623 whether the response is "Contact later" 
is determined. If the response is "Contact later" it is as- 
sumed that the apparatus B wants a contact later, and 

30 the above described processes at step SI 61 4 and the 
following steps are performed. When, at step 81623, the 
response is not "Contact later' it is assumed that the 
response is "OK" and at step 81 624 the response is con- 
firmed. If the response is not "OK" an error occurs. At 

3S step 81631 an error message is displayed. 

When the response is 'OK' at step SI 625 a check 
Is performed to determine whether or not a negotiation 
with the apparatus B is required for the current opera- 
tion. If the negotiation is required, at step SI 626 a ne- 

^0 gotiation is initiated. The object to be negotiated in- 
cludes a data format for data execute and protocolA/er- 
sion exchange, and a data format for other information 
required in advance for correct communication. This ne- 
gotiation is repeated until the communication base used 

^ in common for the apparatuses A and B is established. 

At step 81 627 according to the operation instruction 
by the user employing the operation unit 41 , an instruc- 
tion Is issued as an request from the apparatus A to the 
apparatus B. At step 81628. a check is performed to 

so determine whether or not a response is received. When 
the response is received, at step SI 629 a check is per- 
formed to determine whether there is an action to be 
executed relative to the received response. The action 
is, for example, conversion of a format or erasure of an 

55 unnecessary header. The object of the communication 
includes actions such as printing, transmission, filing, 
voice output and display. This means that necessary ac- 
tions should be executed, and at step 81630 these ac- 
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tions are added to the task table. 

When, at step SI 628. there is no response, the 
above described processes at step S1 61 4 and the fol- 
lowing steps are performed. The above processing loop 
is continued until requested information is obtained or s 
until the system can not continue the processing. 

[Fifty-third Embodiment] 

Figs. 140A and 140B are flowcharts showing the io 
processing for <RESPOND> task. 

<RESPOND> task is performed when an apparatus 
B (destination) that receives a COMMUNICATE request 
sends a response. In Figs. 140A and 140B are shown 
the processing that is to be executed by the apparatus 
B that receives a COMMUNICATE request (e.g., PULL) 
from a transmission apparatus (source) A. 

At step SI 71 2 a check is performed to determine 
whether or not a request type is contact. If the request 
is contact, the apparatus A attempts to establish con- 20 
nection with the apparatus B for communication. At step 
SI 71 3 the current status or a specific user's set value 
is allocated for status SI. At step S1314 whether the 
status S1 is a "Very busy" mode or a "Standby" mode is 
determined. If the status SI is either mode, it is assumed 25 
that the apparatus B can not accept the request from 
the apparatus A. Then, at step SI 71 5 the optimal re- 
sponse is decided. A check is performed to determine 
whether or not the apparatus B can call back the appa- 
ratus A any time, if the apparatus B can call back, pro- 30 
gram control moves to step SI 71 6 and response "Will 
call back" is transmitted. If the apparatus B can not call 
back, at step 81 71 7 response "Contact later" is trans- 
mitted. This means that the apparatus A must contact 
the apparatus B later. When, at step SI 71 4, the status 35 
A1 is neither a "Very busy" mode nor a "Standby" mode, 
f'esponse "OK" is transmitted. The processing is there- 
after terminated. 

When the request type is not contact, at step SI 71 9 
a check is performed to determine whether the request 40 
type is a request for information. If so, at step SI 720 a 
response is transmitted relative to the request for infor- 
mation, which will be described later in Fig. 141. When 
the request type is not a request for information, at step 
SI 721 a check is performed to determine whether the 4S 
request type is a request for storage of information. If 
so, at step 81722 a response relative to the request for 
storage of Information, which will be described later in 
Fig. 142. is issued. If the request type is not a request 
for storage of information, at step SI 723 a check is per- 50 
formed to determine whether the request type is a re- 
quest for an instruction. If so, at step SI 724 a response 
relative to the request for an instruction, which will be 
described later, is issued. If the request type is not a 
request for an instruction, at step SI 725 an optimal re- ss 
sponse is issued, and the processing is thereafter ter- 
minated. 

Fig. 141 is a flowchart showing a response task rel- 



ative to the request for information. In this flowchart, a 
process will be explained that is initiated when the re- 
quest type is a request for information (step S1720 in 
Figs. 140A and 140B). 

At step S1812 a check is performed to determine 
whether or not negotiation is required with the apparatus 
A that issued the request for an instruction. If the nego- 
tiation is required, program control moves to step 
SI 81 3. whereat the negotiation is initiated. The object 
to be negotiated includes a data format for data execute 
and protocol/version exchange, and a data format for 
other information required in advance for correct com- 
munication. This negotiation is repeated until the com- 
munication base used in common for the apparatuses 
A and B is established. 

Following this, at step S1814 fetching of requested 
information is performed. At step SI 81 5, a check is per- 
formed to determine whether or not the requested infor- 
mation is found. If the information is not found, at step 
SI 81 6 response ~ NG is transmitted and the processing 
is terminated. 

If the requested information is found, at step SI 81 7 
a check is performed to determine whether the informa- 
tion should be transferred immediately. If the Immediate 
transmission is required, program control moves to step 
SI 820, whereat a check is performed to determine 
whether or not data formatting or data conversion is re- 
quired. If data formatting or data conversion is required, 
at step SI 81 9 it is performed. Then, at step SI 820 the 
requested information Is transmitted as a response and 
the processing Is thereafter terminated. If the immediate 
transmission is not required, program control moves to 
step SI 821 , whereat a taskfor transmitting the data later 
is added to the task table. At step SI 822 response = OK 
is issued, and the processing is terminated. 

Fig. 1 42 is a flowchart showing a response task rel- 
ative to the request for storage of Information. In this 
flowchart, a process will be explained that is initiated 
when the request type is a request for storage of infor- 
mation (step SI 722 in Figs. 140A and 140B). 

At step SI 912 a check is performed to determine 
whether or not negotiation Is required with the apparatus 
A that issued the request for an instruction, if the nego- 
tiation is required, program control moves to step 
S2013, whereat the negotiation is initiated. The object 
to be negotiated includes a data format for data execute 
and protocol/version exchange, and a data format for 
other information required in advance for correct com- 
munication. This negotiation is repeated until the com- 
munication base used in common for the apparatuses 
A and B is established. 

Following this, at step 81914 information transmit- 
ted for the apparatus A is acquired. At step SI 91 5 
whether or not the information is received is determined, 
If the information is not yet received, program control 
goes to step SI 91 6, whereat response = NG is returned, 
and the processing is terminated. If the information re- 
ceived, whereat a check is performed to determine 
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whether or not data formatting or data conversion is re- 
quired. If data formatting or data conversion is required, 
at step SI 918 it is performed. Then, at step S1919 re- 
sponse = OK is issued, and the processing is terminat- 
ed. 

Fig. 143 is a flowchart showing a response task rel- 
ative to a request for an instruction. In this flowchart, a 
process will be explained that is initiated when the re- 
quest type is a request for an instruction (step S1724 in 
Figs. 140Aand 140B). 

At step S2012 a check is performed to determine 
whether or not negotiation is required with the apparatus 
A that issued the request for an instruction. If the nego- 
tiation is required, program control moves to step 
S1913, whereat the negotiation is initiated. The object 
to be negotiated includes a data format, conversion pro- 
tocol, upgrading of a version, adjustments associated 
with alteration of information types, and specification of 
the instruction contents. The negotiation process is 
planed before this process is initiated. 

Following this, at step S2014 instruction information 
Is interpreted to decide a process to be performed next. 
At step S201 5 a check is perfonned to determine wheth- 
er or not the process can be executed. If the process 
can not be pertormed. response = NG Is returned and 
the processing is terminated. 

When the process can be performed, program con- 
trol moves to step S2017, whereat whether or not im- 
mediate execution is required. If the process need not 
be performed immediately, program control goes to step 
S2020, whereat a task for designating the performance 
of a corresponding process is added to the task table, 
and response = OK is returned. The processing is there- 
after terminated. 

If the process should be immediately perlormed, 
program control advances to step S2018, whereat the 
instructed process is performed. The processing is 
thereafter terminated. 

[Fifty-fourth Embodiment] 

An explanation of PULL task, for example pull print- 
ing for extracting and printing information, i.e.. an exam- 
ple print on demand process will now be given, by re- 
ferring to Fig. 133. 

In the example in Fig. 1 33, a user sends an instruc- 
tion 1333 to a printer A1 331 to extract information 1 334 
"contract. doc" included in an apparatus B1332 that is 
located physically away from the printer A and to permit 
the printer A to print the information 1334. The appara- 
tus B can be a printer, a scanner, a desktop PC, or a 
filing server. 

The contents "Please fetch 'contract. doc' from B 
and print it" which is an \nstrucllon from the user to the 
printer A1 331 , may be a command input using a mouse, 
or via a keyboard, by voice or a digitizer, or may be a 
sentence in the natural language by character recogni- 
tion. 



When the apparatus B is a different device type from 
the apparatus A, e.g.. a scanner, the information format- 
ting is TIFF. BMP or JPEG, and format conversion is re- 
quired. This data conversion may b© perlormed either 
s by the apparatus 8 or by the printer A to obtain the ap- 
propriate data format. When the apparatus B is a printer 
and information of the apparatus B has a format that the 
printer A can understand (e.g., when both apparatuses 
A and B are PCL printers), data conversion is not re- 
10 quired. In other cases, even when both apparatuses are 
printers, data conversion is necessary. It should be not- 
ed that the apparatus A is not necessary a printer and 
may be another output device, such as a facsimile ma- 
chine, a copier or a display. 

The transmission of information for the PULL task 
will now be described. Fig. 144 is a diagram showing an 
example pull session. In this example, the apparatuses 
A and B are printers, but as is described above, the ap- 
paratuses A and B need not necessarily be the same 
20 device type, and can be a scanner, a printer, a copier or 
a facsimile machine. 

The apparatus A performs the procedures in Figs. 
1 37 A and 1 37B while the apparatus B performs the pro- 
cedures in Fig. 141. First, the apparatus A contacts the 
25 apparatus B to establish a connection for communica- 
tion (step SI 41 2). When the response is OK (steps 
S1424 and SI 822), a request for infomnation (informa- 
tion <abc> in this example) and an information format, 
if necessary, are transmitted to the apparatus B (step 
30 S1427). 

The apparatus B fetches the requested Information 
(step S1814), converts the format, as needed (step 
SI 81 9). and transmits information in response to the re- 
quest (step SI 820). 

3S When the apparatus A extracts infomiation from the 
apparatus B, it executes a necessary action In accord- 
ance with the instruction from the user or the determi- 
nation of the system. The necessary action is, for exam- 
ple, printing, and in this case, pull printing is performed, 

40 i.e., information is extracted from a remote area and 
printed. In other words, print on demand can be accom- 
plished. 

Another necessary action is a display. In this case, 
pull viewing is performed, i.e., information is extracted 

4S from a remote area and displayed. In other words, view 
on demand can be accomplished. An additional neces- 
sary action is audio output. In this case, pull hearing is 
performed, i.e., information is extracted from a remote 
area and can be listened to. In other words, hear on de- 

50 mand can be accomplished. 

Similarly, further necessary actions are storage, fil- 
ing and transferring. Any type of information can be ex- 
tracted; a document, a file, electronic mail a schedule, 
a status report, a log, voice mail or telephone call. 

55 

[Fifty-fifth Embodiment] 

Fig. 1 45 is a diagram showing another example pull 
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session. Along the same procedure as in Fig. 144, the 
apparatus A requests intormation <abc> to the appara- 
tus B. However, the apparatus B does not immediately 
transmits the requested information (No at step SI 81 7). 
A task for transmitting the data later is added to the task 
table (step SI 821), and response = OK is returned to 
terminate the processing (step S1822). In this case, the 
transfer of the requested information is a print request 
from the apparatus B after a new session is established. 

[Fifty-sixth Embodiment] 

Fig. 146 is a diagram showing an additional exam- 
ple pull session. In this example, a negotiation is held 
before the transfer of necessary information (steps 
81425 and S1426 and steps 81812 to 81822). Since 
the information to be extracted by the apparatus A Is a 
file, the apparatus A requests the apparatus B for a list 
of files. The apparatus B transmits the list of files to the 
apparatus A. From the list, the apparatus decides infor- 
mation necessary for the system or instructs the input 
of information necessary for a user. The apparatus A 
then decides the information to be requested, and is- 
sues a request for information to the apparatus B in the 
same manner as described above. 

[Fifty-seventh Embodiment] 

Fig. 147 is a diagram showing an example of Hear 
On Demand. In this example, "Read out New Mail' is 
input. While, in Fig. 1 47. an input window is employed 
for this input, any input device, such as a voice input 
device, a keyboard or a digitizer, can be employed as in 
the previous examples. 

In this example, the above command is transmitted 
to an apparatus A (printer) at Kosugi, and mall to be out- 
put is stored in an apparatus B (desktop PC) at Shl- 
momaruko. The apparatuses A and B may be located 
in the same place, or in the same or different network 
domain. This session will be described while referring 
to Fig. 148. 

Fig. 148 is a diagram showing a further example pull 
session. Information type is electronic mail and a re- 
quested format is voice. The procedures are, however, 
the same as previously described. 

The apparatus A requests the information (mail) 
(step SI 427), the apparatus B converts the requested 
data into a suitable format (voice format In this example) 
(step SI 81 9), and sends a response. Then, the appa- 
ratus A performs an optimal action. Since the optimal 
action is output of information by voice, the contents of 
mail is read aloud. While, in this example, the apparatus 
B converts text data into voice format, when the appa- 
ratus B can not convert the data the apparatus A may 
perform such conversion before the data output. 



[Fifty-eighth Embodiment] 

Fig. 149 is a diagram for explaining another pull 
task. In this example, an apparatus C is employed to 

s issue a command to an apparatus A. The apparatus A 
is a display, and an instruction "Display my schedule" is 
issued to the apparatus C. Although the communication 
is not specified in the instruction, it means that a user 
extracts schedule data from the apparatus B (user's 

10 desktop PC) and displays it on the apparatus A. 

While the information type is schedule information, 
the procedures for this is the same as explained previ- 
ously. 

15 [Fifty-ninth Embodiment] 

Fig. 150 is a diagram for explaining an example 
push task. In this example, an apparatus A that receives 
a command is a scanner. The command shown in Fig, 
20 150 is issued to instruct the apparatus A to transmit a 
document obtained by scanning to an apparatus B 
(printer) and to instruct the apparatus B to hold the doc- 
ument instead of printing it. This session will now be de- 
scribed. 

25 Fig. 1 51 is a diagram showing a session for the push 
task in Fig. 150. As is described above, the apparatus 
A is a scanner and the apparatus B is a printer. 

The apparatus A performs the procedures in Figs. 
1 38 A and 1 38B while the apparatus B performs the pro- 

30 cedures in Fig. 1 32. First, the apparatus A contacts the 
apparatus B to establish a connection for communica- 
tion (step S1512). Assume that the response is OK 
(steps SI 524 and SI 71 8). 

Then, transfer of information (information <abc>) Is 

35 requested. Since the request type is a request storage 
of information, the apparatus performs the procedures 
in Fig. 142. At the negotiation (step S1526 and 31913). 
the apparatus B requests the apparatus A for a format 
(<xyz>) of information to be transferred. 

40 The apparatus A changes the format, if necessary 
and transmits the requested information (step S1527). 
Upon the receipt of the information, the apparatus B per- 
forms a required action according to the decision of the 
transmission side, the user or the apparatus B, The ac- 

45 tion is, for example, fomnat conversion, filing, index 
preparation, data extraction, or title extraction. The nec- 
essary action in this embodiment is to hold a received 
document instead of printing it. 

50 [Sixtieth Embodiment] 

Fig. 152 is a diagram showing another example 
push task. The apparatus A, which is a scanner in this 
example, sends a request to the apparatus B (scanner) 
55 and the apparatus C (filing server) to push information, 
to file a document on a reception side and to extract its 
title and index. 

The specific processing is the same as that in the 
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fifty-ninth embodiment. The session between the appa- 
ratuses A and B will now be described while referring to 
Fig. 153. The same thing is applied for the session be- 
tween the apparatuses A and C. Communication be- 
tween the apparatuses A and B and communication be- 
tween the apparatuses A and C are performed in paral- 
lel. 

Fig. 153 is a diagram showing an example push 
session. The apparatuses A and B are scanners, when 
the apparatus B receives data, it performs a required 
action. In this case, the apparatus A transmits informa- 
tion for designating an associated action that should be 
executed. The action is filing and extraction of a title and 
an index. While in this example the action is instructed 
from the apparatus A, the apparatus B may decide an 
action, and may abandon a received action. 

[Sixty-first Embodiment] 

Fig. 154 is a diagram showing another example 
push task; which is a transmission of electronic mail. An 
apparatus A (printer) at Kosugi is to transmit electronic 
mall "Get design from Bill" to an apparatus B (having a 
different network sub-domain from John's PC and the 
apparatus A) In New York. 

Any method can be used for mail transmission. 
First, when the apparatus A has a mail transmission 
function, it transmits the mail. If the apparatus A does 
not have such a function, it transmits mail information to 
another apparatus on the network, e.g.. a mail server, 
and asks the mail transmission. 

[Sixty-second Embodiment] 

The instruction task INDICATE will be described 
while referring to Fig. 132. A user sends an instruction 
93 to a copier 91 that is physically located in a remote 
area in order to permit a MyDesk 92, a desktop personal 
computer, to display the current location of the user. 

The instruction 93 "Display present place on 
<MyDesk>", which is sent to the copier 91 that serves 
as the information processing apparatus 411 , is trans- 
mitted from the operation unit 41 to the task reception 
unit 43. The contents are analyzed and planning is per- 
formed on the results. Then, the execution unit 47 exe- 
cutes the final data as an instruction task INDICATE for 
a PC 92, which serves as the information processing 
apparatus 412 connected via the network. 

The PC 92, which is the information processing ap- 
paratus 412 connected via the network, receives in- 
structed information from the reception unit 43, analyzes 
a received instruction, and perform planning on the re- 
sults. Then, the execution unit 47 displays the location, 
such as "Now in conference Shimomaruko A111 confer- 
ence room" on a screen. 

Transmission of information for each session be- 
tween the information processing apparatuses 41 1 and 
412 will be explained while referring to Fig. 155. Fig. 155 



is a diagram showing transmission of information for 
each session between a copier, which serves as the in- 
formation processing apparatus 411 for instruction task 
INDICATE, and a PC, which serves as the information 
s processing apparatus 41 2. 

The transmission side performs the processing in 
Figs. 1 39A and 1 39B, while the reception side performs 
the processing in Fig. 143. The communication contents 
are an instruction and infomnation for processing corre- 
sponding to the instruction. The transmission of infor- 
mation is the same as that in the above described push 
task. 

In response to the instruction request from the ap- 
paratus A, the apparatus B transmits <xy2> instruction 
type that can be understood by the apparatus B. Upon 
receipt of the information, the apparatus A changes the 
instruction information, as needed. 

Then, the apparatus A issues, to the apparatus B, 
an instruction and necessary information to display on 
the PC screen the fact that a conference is being held 
and the current location. The apparatus B receives the 
information, performs the process in consonance with 
the information, and displays the location of the user on 
the screen, as is instructed. 

[Sixty-third Embodiment] 

Another example instruction task INDICATE will 
now be described while referring to Fig, 130. A user 
sends an instruction 71 to a copier 74 at a physically 
remote area in order to set a facsimile machine 75 at 
Shinkawasaki so that It transfers, to a printer 77 of Mr. 
Toyoda at Kosugi, a document that is received from Mr. 
Suzuki. 

The instruction 71 "Please advice MyFax to transfer 
any document sent from Mr. Suzuki to Mr. Toyoda" which 
Is sent to the copier 74 that serves as the Information 
processing apparatus 411 , is transmitted from the oper- 
ation unit 41 to the task reception unit 43. The contents 
are analyzed and planning is performed on the results. 
Then, the execution unit 47 executes the final data as 
an instruction task INDICATE for the facsimile machine 
75. which serves as the information processing appara- 
tus 412 connected via the network. 

The facsimile machine 75, which Is the Information 
processing apparatus 412 connected via the network, 
receives instruction information from the reception unit 
43, analyzes a received instruction, and perform plan- 
ning on the results. Then, the execution unit 47 alters 
the condition setting. The transmission of Information for 
each session between the information processing ap- 
paratuses 411 and 412 will be described while referring 
to Fig. 156. 

Fig. 1 56 is a diagram showing transmission of infor- 
mation for each session between a copier, which serves 
as the information processing apparatus 411 in this ex- 
ample instruction task INDICATE, and a facsimile ma- 
chine, which swerves as the information processing ap- 
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paratus 412. The transmission side performs tine 
processing in Figs. 139A and 139B, while the reception 
side performs the processing in Fig. 143. The transmis- 
sion of information is the same as that in the above de- 
scribed example. s 

In response to the inslructbn request from the ap- 
paratus A, the apparatus B transmits <xyz> instruction 
type that can be understood by the apparatus B. Upon 
receipt of the information, the apparatus A changes the 
instruction information, as needed. In this example, the fo 
apparatus A transmits to the apparatus B an instruction 
and necessary information to transfer, to Mr. Toyoda, a 
document that is transmitted from the Mr Suzuki and 
addresses the user. Upon receipt of the information, the 
apparatus B performs the required processing in con- ts 
sonance with the information, and sets a designated 
condition. 

[Sixty-fourth Embodiment] 

20 

An additional example instruction task INDICATE 
will now be described while referring to Fig. 1 35. A user 
sends an instruction 1 23 to a scanner 1 21 at a physically 
remote area in order to instruct a filing server 1 22 to 
transfer a stored document 1 25 "abc.doc" to John 1 24. 2S 

The instruction 123 "Action: SEND. What: r, From: 
Filing Server, To: John" which is sent to the scanner 121 
that serves as the information processing apparatus 
41 1 , is transmitted from the operation unit 41 to the task 
reception unit 43. The contents are analyzed and plan- 30 
ning is performed on the results. Then, the execution 
unit 47 executes the final data as an instruction task IN- 
DICATE for the filing server 122, which serves as the 
information processing apparatus 412 connected via 
the network. 35 

The filing server 122, which is the information 
processing apparatus 412 connected via the network, 
receives instruction information from the reception unit 
43, analyzes a received instruction, and perform plan- 
ning onlhe results. Then, the execution unit 47 transmits 40 
a document. The transmission of information for each 
session between the information processing apparatus- 
es 411 and 412 will be described while referring to Fig. 
157. 

Fig. 1 57 is a diagram showing transmission of infor- 
malion for each session between a scanner, which 
serves as the information processing apparatus 411, 
and a filing server, which serves as the information 
processing apparatus 412. The transmission side per- 
forms the processing in Figs. 1 39A and 1 398, while the 50 
reception side performs the processing in Fig, 143. The 
transmission of information is the same as that in the 
above described example. 

In response to the instruction request from the ap- 
paratus A, the apparatus B transmits <xyz> instruction ss 
type that can be understood by the apparatus B. Upon 
receipt of the information, the apparatus A changes the 
instruction information, as needed. In this example, the 



apparatus A transmits to the apparatus B an instructkan 
and necessary information to transfer, to John, a docu- 
ment "abc.doc" that is stored in the filing server. 

Upon receipt of the information, the apparatus B 
performs the required processing in consonance with 
the information, decides an optimal transmission meth- 
od, such as E-mail, and transmits the document to John 
as is instructed. 

[Sixty-fifth Embodiment) 

Fig. 156 is a diagram showing an operation along 
the procedures of another apparatus. In the sixty -fourth 
embodiment explained while referring to Fig. 1 35, a user 
sends an instruction to the scanner 121 that is located 
at a physically remote area, in order to instruct the filing 
server 122 to transfer the stored document 125 "abc. 
doc" to the John's desktop 124. And the scanner 121 
interprets contents and executes the instruction task IN- 
DICATE. 

In this embodiment, however, a printer 351 receives 
operation information 353 from a filing server 352 and 
displays it. and a user performs operation in accordance 
with the display and transmits the operation data to the 
filing server 352. In this manner, the same effect as in 
the sixty-fourth embodiment can be obtained. 

When a user requests the printer 351 , which serves 
as the information processing apparatus 411 , to operate 
the filing server 352, a planning decision unit 46 in the 
printer 351 makes a plan that necessary operation data 
353 should be obtained to implement the operation pro- 
cedures of the filing server 352. The process execution 
unit 47 executes the information acquisition task PULL 
for the filing server 352, which is the information 
processing apparatus 412 connected via the network. 

The filing server 352, which is the information 
processing apparatus 412 connected via the network, 
receives instruction request information from the recep- 
tion unit 43, analyzes a received request, and perform 
planning on the results. Then, the execution unit 47 
transmits the operation data 353. 

A screen is provided on the operation unit 41 of the 
scanner 351, which receives the operation data 353 
from the filing server 352, and the operation unit 41 dis- 
plays, on the screen, the procedures of the filing server 
352 that correspond to the operation data 353. 

According to the displayed operation screen, the in- 
formation concerning the operation of the user is trans- 
mitted to the filing server 352 in the same manner. The 
filing server 352 that receives the operation of the user 
interprets it and performs a necessary process. As a re- 
sult, transmission of the file "abc.doc" to John, which is 
the object to the user, is enabled. 

In the above description, the filing sen/er 352 trans- 
mits the operation data 353 for implementing the oper- 
ation procedures of the filing sen/er 352; however an 
operation data server may be prepared for managing 
the operation data 353, and may transmit the operation 
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data 353. The operation data may also be transmitted 
from the third information processing apparatus that re- 
ceives the operation data 353 of the filing server 352, 
like the printer 351 that serves as the information 
processing apparatus 411. The printer 351 may be re- 
placed with a scanner 

[Sixty-sixth Embodiment] 

Fig. 162 is a diagram showing the relationship be- 
tween the change to three statuses of a print job and 
processes corresponding to the individual statuses. An 
output device (printer), which serves as the information 
processing apparatus 411, receives a print job that in- 
cludes a document for which a user instructed printing. 

First, an input job determination unit 391 deter- 
mines whether a received print job should be immedi- 
ately printed or should be held until a print execution 
condition is established. The result is transmitted to a 
pending job management unit 392 or an output wait job 
management unit 394. 

The pending job management unit 392 stores the 
received print job as a pending job in a pending job table 
393. The pending job management unit 392 examines 
the pending job table 393 tor the job for which print ex- 
ecution condition is established. If such a job is found, 
it is extracted from the pending job table 393. The pend- 
ing job for which the print condition is established is 
transmitted to the output wait job management unit 394. 

The output wait job management unit 394 stores a 
received print job as an output wait job In an output wait 
job table 395. When printing at the output unit 396 is 
enabled, the output wait job is extracted from the output 
wait job table 395 and transmitted to the output unit 396. 

The output unit 396 prints the received job. When 
printing is successful, the print job is transmitted to an 
output job management unit 397 to store the print job 
that has been output. 

The output job management unit 397 stores, as an 
output job, the received print job that has been output 
in an output job table 398. 

As is described above, the received print job is 
changed into three statues and processed. The print ex- 
ecution condition of a pending job is not only a condition 
where the job is held until the user instructs printing, but 
also a condition where printing is initiated at a designat- 
ed time, or a condition where, If the main printer is other 
than printer A that serves as the information processing 
apparatus 411, the main printer is ready for printing. 

Figs. 163A and 163B are flowcharts showing the 
printing processing for this embodiment. The process- 
ing of a print task "PRINT (A, 'abc.doc')" or "PRINT (not 
A, 'abc.doc')" is performed when an instruction is issued 
to the printer A, which is the information processing ap- 
paratus 41 T to print document "abc.doc" by the printer 
A and by a printer other than the printer A. 

When the print task PRINT is activated, at step 
S4001 a check is performed to determine whether or not 



a document to be printed Is Included In a print job. When 
there Is no document to be printed, program control 
moves to step S4002. At step S4002 a check is per- 
formed to determine whether the document is included 
5 among the documents in the print jobs that are entered 
in the pending job table 393, the output wait job table 
395 or the output job table 398. When, at step S4003. 
the document is not found, program control advances 
to step S4004. 

10 At step S4004 the information acquisition task 
PULL is performed in order to acquire the document 
from another information processing apparatus 41 2. If. 
at step S4005, it Is ascertained that the document is suc- 
cessfully acquired, program control advances to step 

15 S4006. If the acquisition of the document fails, program 
control moves to step S4016, whereat an error is dis- 
played and another necessary process is performed. 
The processing Is thereafter terminated. At step S4006 
a check is performed to determine whether the docu- 

20 ment to be printed can be printed by the printer A, which 
is the information processing apparatus 411, or by a 
printer other than the printer A. If the conversion of the 
document into a printer description language is re- 
quired, program control moves to step S4007. 

2S At step S4007 a check is performed to determine 
whether or not the printer A, which is the information 
processing apparatus 41 r can convert the document 
form. If the conversion is possible, program control goes 
to step S4008. whereat the document to be printed is 

30 converted into a suitable form. When the conversion is 
impossible, program control goes to step S4009, 
whereat instruction INDICATE is Issued to another in- 
formation processing apparatus 412 to convert the doc- 
ument to be printed. According to the instruction INDI- 
ES GATE, the information processing apparatus 412 may 
immediately perform the conversion and return the re- 
sult, or may return only an acknowledgement and per- 
form conversion after printing is instructed later. 

At step S4010 a check is performed to determine 

40 whether or not the conversion result is successful. If it 
is successful, program control advances to step S4011 . 
If the conversion fails, program control moves to step 
S4016, whereat an error is displayed and another re- 
quired process is performed. The processing is thereaf- 

^ ter terminated. 

At step S4011 a check is performed to determine 
whether or not the printer A, which is the information 
processing apparatus 411, should print a document. 
When it is determined the printer A should print the doc- 

50 ument, program control advances to step S4012, and 
the document Is printed. When the infomnation process- 
ing apparatus 412 should print the document, program 
control goes to step S401 3, and the information storage 
task PUSH and print task PRINT for the information 

55 processing apparatus 412 are performed. 

At step S4014, whether or not the printing is suc- 
cessful is determined. When the printing is successful, 
program control advances to step S4015, and the print 
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job is regarded as the output job, which is then stored 
in the output job table 398. The other necessary process 
is performed, and the processing is terminated. When 
the printing tails, program control moves to step S401 6, 
whereat an error is displayed and another required proc- 
ess is performed. The processing is thereafter terminat- 
ed. 

The conversion of the document at step S4008 in- 
cludes a conversion of a normal text document into a 
document in a printer description language; a conver- 
sion of a document in a specific printer language Into 
another printer language that the employed printer can 
understand; a conversion of an Image format document 
read by a scanner or a digital camera into a document 
in a printer language; or a conversion of a document in 
the common language in WWW into a printer language. 

The conversion instruction INDICATE at step 
S4009 may be an instruction to the information process- 
ing apparatus 412 that has a specific application to con- 
vert a document in a language inherent to the corre- 
sponding application into a document in a printer lan- 
guage that can be printed; or an instruction to the infor- 
mation processing apparatus 412 that has a specific 
printing function to convert a document in a language 
inherent to a specific printer into a document in a printer 
language that can be printed. 

Fig. 164 is a diagram showing the relationship be- 
tween the print job and the processing, which are ex- 
plained while referring to Figs. 1 62 and 1 63, and the us- 
er's operation. When a user permits the scanner A411 , 
which serves as the information processing apparatus 
412, to read document "abc.doc" 144 and issues an in- 
struction "Send 'abc.doc' to printer B" the printer B 41 2, 
which sen/es as the information processing apparatus 
411 that receives the print job. does not print "abc.doc" 
immediately, but regards it as a pending job and stores 
ft in the pending Job table 393. 

When the user sends an instruction "Show pending 
documents" the document "abc.doc" is displayed on the 
operation panel of the printer B. Furthermore, when the 
user designates the document "abc.doc" and issues an 
erasure instruction "Delete pending document" the des- 
ignated document is deleted from the pending job table 
393. 

When the user designates the document "abc.doc" 
and issues an instruction "Print pending document" the 
document "abc.doc" Is changed to a print wait job, which 
is then stored in the output wait job table 395. When the 
printing is enabled, it is printed (415). 

When the printing is successful, the document "abc. 
doc" is changed to the output job, which is then stored 
in the output job table 395. in addition, when the user 
designates the output document "abc.doc" and issues 
an erasure instruction "Delete printed document" the 
designated document is deleted from the output job ta- 
ble 398. 

Fig. 165 is a diagram showing an example display 
screen that is used by a user to operate a print job in the 



three statues as explained in Fig. 162. In accordance 
with the operation by a user, an instruction from the in- 
formation processing apparatus 412, or the result ob- 
tained by the process performed by the information 
5 processing apparatus 41 1 , the print jobs in the three sta- 
tuses are operated arbitrarily, and are added as a new 
task to the task table 399. 

For example, a user utilizes the operation screen in 
Fig. 1 65 to delete (4209) a print job stored in the pending 
10 job table 393 (4201 ), to send (4208) the print jot to print 
using another printer, or to print it immediately. It is also 
possible to instruct to increase the priority (4210) of a 
print job stored in the output wait job table 395 (4202) 
so that it will be printed first, or a print job, or to print 
IS (4204) again the print job stored in the output job table 
398 (4203). 

The present invention can be applied either for a 
system that is constructed by a plurality of apparatuses 
(e.g., a host computer, an interface device, a display) or 
for an apparatus including a single device. 

The following is also included within the scope of 
the present Invention: in order to operate various devic- 
es to implement functions in the above embodiments, 
software program code for implementing the functions 
in the previous embodiments are supplied to a computer 
in an apparatus or in a system that is connected to var- 
ious devices, and in consonance with the program, the 
computer (or a CPU or an MPU) In the system or the 
apparatus operates the devices to accomplish the func- 
tions in the above embodiments. In this case, the pro- 
gram code read from a memory medium accompUshes 
the functions of the above described embodiments. And 
the program code and means for supplying the program 
code to the computer, e.g., a memory medium on which 
such program code is recorded, constitute the present 
invention. 

A memory medium for supplying such program 
code can be, for example, a floppy disk, a hard disk, an 
optical disk, a magneto optical disk, a CD-ROM. a CD- 
R, a magnetic tape, a nonvolatile memory card, or a 
ROM. 

In addition, not only for a case where the functions 
in the previous embodiments can be performed when 
program code is read and executed by the computer 
but also for a case where, according to an Instruction in 
the program code, an OS (Operating System) running 
on the computer, or another application software pro- 
gram, interacts with the program code to accomplish the 
functions in the above embodiments, this program code 
can be included in the embodiments of the present in- 
vention. 

Furthermore, the present invention includes a case 
where program code, read from a memory medium, is 
written in a memory that is mounted on a function ex- 
pansion board inserted into a computer, or in a function 
expansion unit connected to a computer, and in conso- 
nance with a program code instruction, a CPU mounted 
on the function expansion board or the function expan- 
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sion unit performs one part, or all of the actual process- 
ing in order to implement the functions in the above de- 
scribed embodiments. 

When the present invention is applied for the above 
memory medium, program code corresponding to the 
previously described flowcharts is stored in the memory 
medium. 



Claims 

1. A printing apparatus comprising: 

reception means for receiving information to be 
printed and a first printing parameter; 
determination means for employing said infor- 
mation that is received to determine a second 
parameter suitable for said information; 
setup means for setting up said first and said 
second parameters; and 
printing means for printing said information 
based on said first and said second printing pa- 
rameters set up by said setup means. 

2. A printing apparatus according to claim 1 , wherein 
said determination means determines a printing pa- 
rameter type that is not received by said reception 
means. 

3. A printing apparatus according to claim 1, wherein 
said determination means specifies another value 
instead of said printing parameter received by said 
reception means. 

4. A printing apparatus according to claim 1, further 
comprising simulation means for simulating the 
printing results, wherein said determination means 
specifies a printing parameter based on the results 
obtained by said simulation. 

5. A printing apparatus according to claim 1, further 
comprising scheduling means for making a printing 
schedule, wherein said delerminalion means deter- 
mines a printing parameter according to said print- 
ing schedule prepared by said scheduling means. 

6. A printing apparatus according to claim 1 , further 
comprising status identification means for Identify- 
ing a slatus of said printing means, wherein said de- 
termination means specifies a printing parameter in 
consonance with said status of said printing means 
identified by said status identification means. 

7. A printing apparatus according to claim 1, wherein 
said status identification means identifies statues of 
a plurality of printing means and selects one of said 
pnnting means based on the results of identifica- 
tion. 



8. A printing apparatus according to claim 1, further 
comprising interpretation means for disambiguating 
a printing request that is received by said reception 
means and is ambiguously described, wherein said 

5 determination means specifies a printing parameter 
based on the results of the disambiguation effected 
by said interpretation means. 

9. A printing apparatus according to claim 1, further 
10 comprising extraction means for extracting a print- 
ing parameter from said information to be printed. 

10. A printing apparatus comprising: 

IS reception means for receiving information to be 

printed; 

identification means for identifying a user for 

said Information that is received; 

printing means lor printing said information; 

20 printing results storage means having a plural- 

ity of storage locations; and 
control means for storing: at a different location 
in said printing results storage means, printing 
results obtained by said printing means for 

25 each user who is identified by said identification 

means. 

11. A printing apparatus according to claim 10, further 
comprising display means for displaying for each 

30 user whether or not there are printing results avail- 
able. 

12. A printing apparatus according to claim 10, further 
comprising display means for displaying, for each 

35 storage location, whether or not there are printing 
results available. 

13. A printing apparatus according to claim 10, further 
comprising display means for displaying a user con- 

40 cerning said printing results. 

14. An information processing apparatus comprising: 

communication means for communicating with 
4S an external device; 

output means for outputting information; and 
control means for requesting information from 
said external device, for receiving said informa- 
tion from said external device, and for permit- 
so ting said output device to output said informa- 
tion. 

15. An information processing apparatus according to 
claim 1 4, further comprising input means for receiv- 
es ing an output request from a user wherein, in re- 
sponse to the receipt of said output request, said 
control means requests information for said exter- 
nal device. 
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16. An information processing apparatus according to 
claim 14, further comprising determination means 
for specifying a status, wherein said control means 
requests information to said eKternal device based 

on results obtained by said determination means. s 

17. An information processing apparatus comprising: 

communication means for communicating with 
an external device; io 
input means for receiving Information; 
processing means for processing said informa- 
tion received by said input means; and 
control means for transmitting said information 
through said communication means to said ex- 
ternal device and requesting said external de- 
vice to process said Information. 

18. An Information processing apparatus according to 
claim 17, further comprising determination means 20 
for specifying a status, wherein, based on the re- 
sults obtained by said determination means, said 
control means transmits information to said external 
device and requests said Information be processed. 

25 

19. An information processing apparatus according to 
claim 17, wherein said control means requests a 
transfer of said information as a part of the process- 
ing for said information. 

30 

20. An information processing apparatus comprising: 

output means for outputting information; 
acceptance means for accepting an output in- 
struction, including designation information in- 3S 
eluded for the designation of an output device; 
detection means for detecting an apparatus 
that is identified in said designation information; 
output control means for permitting said output 
means to execute said output instruction when 40 
said apparatus detected by said detection 
means is said information processing appara- 
tus, and for transmitting said output instruction 
to an external device when said apparatus de- 
tected by said detection means is other than 4S 
said information processing apparatus. 

21. An information processing apparatus according to 
claim 20, wherein said output means prints said In- 
formation, so 

22. An information processing apparatus according to 
claim 20, wherein said output means displays said 
Information. 

55 

23. An information processing apparatus comprising: 

communication means for communicating with 
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an external device; 

processing means for processing information; 
management means for receiving from said ex- 
ternal device through said communication 
means information to be processed and for 
managing said information by employing a plu- 
rality of management states, including a proc- 
ess pending state and a process wait state; and 
control means for permitting said processing 
means to process said information. 

24. An information processing apparatus according to 
claim 23, wherein said plurality of management sta- 
tuses include a processed status; 

25. An information processing apparatus according to 
claim 23, further comprising: 

determination means for ascertaining whether 
said information that is received is to be per- 
fomried immediately, and 
decision means for specifying a management 
status for said Information based on the results 
obtained by said determination means. 

26. An information processing apparatus according to 
claim 23, further comprising: 

examination means for examining an execution 
condition of said Information In said pending 
state; and 

alteration means for altering, according to the 
results obtained by said examination means, 
said management status of said information, for 
which said execution condition is established, 
to said process wait state. 

27. An Information processing apparatus according to 
claim 23, further comprising: 

setup means for setting priorities for said in- 
formation in said processing wait state, wherein 
said control means performs a process for informa- 
tion, among information in said processing wait 
state, that has a higher priority. 

28. An information processing apparatus according to 
claim 23, further comprising: 

alteration means for changing said manage- 
ment status for information in said processing wait 
state to a processed status. 

29. An information processing apparatus according to 
claim 23, wherein said processing means is capa- 
ble of performing a deletion, a search, an output or 
an alteration process for information that is to be 
processed. 

30. An information processing apparatus according to 
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claim 29, wherein said output processing includes 
the display, printing or transmission of data. 

31. An information processing apparatus according to 
claim 29, wherein said alteration process Includes 
alteration of either an execution condition, a main 
processing device, or a priority. 

32. An information processing apparatus according to 
claim 23, wherein an execution condition is added 
to said information to be processed. 

33. An information processing apparatus according to 
claim 23, wherein said execution condition includes 
an instruction by a user, an expiration period for 
processing, or a status of another device. 

34. An information processing apparatus comprising: 

reception means for receiving a process to be 
performed by another device; 
processing means for performing a predeter- 
mined process required for the performance of 
said process received by said reception means; 
and 

output means for outputting the results ob- 
tained by said processing means. 

35. An information processing apparatus according to 
claim 34, wherein said output means outputs to said 
device said processing results. 

36. An Infomnation processing apparatus according to 
claim 34, wherein said predetermined process is a 
pre-process for said process that is received. 

37. An information processing apparatus according to 
claim 34, wherein said pre-process is the acquisi- 
tion of a target for said process that is received. 

38. An information processing apparatus according to 
claim 34, wherein said pre-process constitutes con- 
version of a format of a target for said process that 
is received. 

39. An information processing apparatus comprising: 

reception means for receiving designation in- 
formation that identifies a target to be proc- 
essed; 

acquisition means for acquiring said target 
identified in said designation information re- 
ceived by said reception means; 
processing means for performing a process for 
said target acquired by said acquisition means; 
and 

output means for outputting the results ob- 
tained by said processing means. 



40. An information processing apparatus according to 

claim 39, wherein said acquisition means searches 
for information in said apparatus and acquires said 
target. 

5 

41. An information processing apparatus according to 
claim 39, wherein said acquisition means acquires 
said target from another device. 

fo 42. An information processing apparatus comprising: 

reception means for receiving information to be 
processed; 

processing means for processing said informa- 

15 tion; and 

conversion control means for controlling a con- 
version of said information that is received by 
said reception means into information, de- 
scribed using a description language, that is to 

20 be processed by said processing means. 

43. An information processing apparatus according to 
claim 42, further comprising conversion means, 
wherein said conversion control means permits 

25 said conversion means to perform conversion. 

44. An information processing apparatus according to 
claim 42, wherein said conversion control means 
requests that an external device perform conver- 
ge sion. 

45. An information processing apparatus according to 
claim 44, wherein an object for said conversion is 
information described in a language inherent to a 

3S specific application or to an output device. 

46. An information processing apparatus according to 
claim 42, wherein said information that is received 
as an object for conversion is either a text docu- 

40 ment, an image format, a specific printer description 

language, or a document description language. 

47. A printing method comprising: 

45 a reception step of receiving information to be 

printed and a first printing parameter; 

a determination step of employing said informa- 
tion that is received to determine a second pa- 
rameter suitable for said information; 
50 a setup step of setting up said first and said sec- 

ond parameters; and 

a printing step of printing said information 
based on said first and said second printing pa- 
rameters set up at said setup step. 

55 

48. A printing method according to claim 47, wherein a 
printing parameter type that is not received at said 
reception step is determined at said determination 
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step. 

49. A printing method according to claim 47. wherein 
another value instead of said printing parameter re- 
ceived at said reception step is specified at said de- s 
termination step. 

50. A printing method according to claim 47, further 
comprising a simulation step of simulating the print- 
ing results, wherein a printing parameter is speci- io 
fied at said determination step based on the results 
obtained by said simulation. 

51. A printing method according to claim 47, further 
comprising a scheduling step of making a printing is 
schedule, wherein at said determination step a 
printing parameter is determined according to said 
printing schedule prepared at said scheduling step. 

52. A printing method according to claim 47. further 2o 
comprising a status identification step of identifying 

a status of a printing unit, wherein at said determi- 
nation step a printing parameter is specified in con- 
sonance with said status at said printing unit iden- 
tified at said status identitication step. 2S 

53. A printing method according to claim 47, wherein at 
said status Identification step statues of a plurality 
of printing units are specified and one of said print- 
ing units is selected based on the results of identi- 3o 
fication. 

54. A printing method according to claim 47, further 
comprising an Interpretation step of disambiguating 

a printing request that is received at said reception 3S 
step and is ambiguously described, wherein at said 
determination step a printing parameter is specified 
based on the results of the disambiguation effected 
at said interpretation step. 

40 

55. A printing method according to claim 47 further 
comprising an extraction step of extracting a print- 
ing parameter from said information to be printed. 

56. A printing method comprising: 4S 

a reception step of receiving information to be 
printed; 

an identification step of identifying a user for 
said information that is received; so 
a printing step of printing said information; 
a printing results storage step of storing printing 
results in one of a plurality of storage locations; 
and 

a control step of storing printing results at a dif- 55 
ferent location for each user who is identified at 
said identification step. 



57. A printing method according to claim 56, further 
comprising a display step of displaying for each us- 
er whether or not there are printing results available. 

58. A printing method according to claim 56. further 
comprising a display step of displaying, for each 
storage location, whether or not there are printing 
results available. 

59. A printing method according to claim 56, further 
comprising a display step of displaying a user con- 
cerning said printing results. 

60. An information processing method comprising: 

a communication step of communicating with 
an external device; 

an output step of outputting information; and 
a control step of requesting information from 
said external device, of receiving said informa- 
tion from said external device, and of permitting 
said output device to output said information. 

61. An information processing method according to 
claim 60, further comprising an input step of receiv- 
ing an output request from a user, wherein, at said 
control step, in response to the receipt of said output 
request, Information is requested for said external 
device. 

62. An Information processing method according to 
claim 60, further comprising a determination step of 
specifying a status, wherein, at said control step, 
information is requested to said external device 
based on results obtained at said determination 
means. 

63. An information processing method comprising: 

a communication step of communicating with 
an external device; 
an input step of receiving information; 
a processing step of processing said informa- 
tion received at said input step; and 
a control step of transmitting said information 
to said external device at said communication 
step and of requesting said external device to 
process said information. 

64. An information processing method according to 
claim 63, further comprising a determination step of 

specifying a status, wherein, at said control step, 
based on the results obtained at said determination 
step, Information Is transmitted to said external de- 
vice and said information is requested to be proc- 
essed. 

65. An information processing method according to 



10 



55 



109 



EP 0 851 384 A2 



110 



claim 63, wherein at said control step a transfer of 
said information is requested as a part of the 
processing for said information. 

66. An information processing method comprising: s 

an output step of outputting information; 
an acceptance step of accepting an output in- 
struction, including designation information in- 
cluded for the designation of an output device; io 
a detection step of detecting an apparatus that 
is identified in said designation information; 
an output control step of permitting said output 
means to execute said output instruction when 
said apparatus detected at said detection step 
is a locally own infonmation processing appara- 
tus, and of transmitting said output instruction 
to an external device when said apparatus de- 
tected at said detection step is other than said 
information processing apparatus. 20 

67. An information processing method according to 
claim 66, wherein said information is printed at said 
output step. 

25 

68. An information processing method according to 
claim 66, wherein said information is displayed at 
said output step. 

69. An information processing method comprising: 30 

a processing step of processing information; 
a management step of receiving information to 
be processed from said external device through 
a communication unit for communicating with 35 
said external device, and of managing said in- 
formation by employing a plurality of manage- 
ment states, including a process pending state 
and a process wait state; and 
a control step of permitting said processing 40 
means to process said information. 

70. An information processing method according to 
claim 69, wherein said plurality of management sta- 
tuses include a processed status; 4S 

71. An information processing method according to 
claim 69, further comprising: 

a determination step of ascertaining whether so 
said Information that Is received Is to be per- 
formed immediately; and 
a decision step of specifying a management 
status for said information based on the results 
obtained at said determination step. 55 

72. An information processing method according to 
claim 69, further comprising: 



an examination step of examining an execution 
condition of said Information in said pending 
state; and 

an alteration step of altering, according to the 
results obtained at said examination step, said 
management status of said information, for 
which said execution condition is established, 
to said processing wait state. 

73. An information processing method according to 
claim 69, further comprising: 

a setup step of setting priorities for said infor- 
mation in said processing wait state, wherein a 
process for information, among information in said 
processing wait state, that has a higher priority is 
performed at said control step. 

74. An information processing method according to 
claim 69, further comprising; an alteration step of 
changing said management status for information 
in said processing wait state to a processed status. 

75. An information processing method according to 
claim 69, wherein at said processing step, it is pos- 
sible to perform a deletion, a search, an output or 
an alteration process for information that is to be 

processed. 

76. An information processing method according to 
claim 75, wherein said output processing includes 
display, printing or transmission of data. 

77. An information processing method according to 
claim 75, wherein said alteration process includes 
alteration of either an execution condition, a main 
processing device, or a priority. 

78. An information processing method according to 
claim 69, wherein an execution condition is added 
to said information to be processed. 

79. An information processing method according to 
claim 69, wherein said execution condition includes 
either an instruction by a user, an expiration period 
for processing, or a status of another device. 

80. An Information processing method comprising: 

a reception step of receiving a process to be 
performed by another device; 
a processing step of performing a predeter- 
mined process required for the performance of 
said process received at said reception step; 
and 

an output step of outputting the results obtained 
at said processing step. 

81. An information processing method according to 
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claim 80, wherein said results of processing to said 
device Is output at said output step. 

82. An information processing method according to 
claim 80, wherein said predetermined process Is a 
pre-process for said process that is received. 

83. An information processing method according to 
claim 82, wherein said pre-process is the acquisi- 
tion of a target for said process that is received. 

84. An information processing method according to 
claim 82, wherein said pre-process constitutes a 
conversion of a formal of a target for said process 
that is received. 

85. An information processing method comprising: 

a reception step of receiving designation infor- 
mation that Identifies a target to be processed; 
an acquisition step of acquiring said target 
identified in said designation information re- 
ceived at said reception step; 
a processing step of performing a process for 
said target acquired at said acquisition step; 
and 

an output step of outputting the results obtained 
at said processing step. 

86. An information processing method according to 
claim 85, wherein at said acquisition step. Informa- 
tion is searched for In a locally own apparatus and 
said target is acquired. 

87. An information processing method according to 
claim 85, wherein, at said acquisition step, said tar- 
get is acquired from another device. 

88. An Information processing method comprising: 

a reception step of receiving information to be 
processed; 

a processing step of processing said informa- 
tion; and 

a conversion control step of controlling a con- 
version of said information that is received at 

said reception step into information, described 
using a description language, that is to be proc- 
essed at said processing step. 

89. An information processing method according to 
claim 88, further comprising a conversion step, 
wherein the performance of conversion at said con- 
version Is permitted at said conversion control step. 

90. An information processing method according to 
claim 88, wherein conversion is requested to an ex- 
ternal device at said conversion control step. 



91. An Information processing method according to 

claim 90, wherein an object for said conversion is 
information described in a language inherent to a 
specific application or to an output device. 

5 

92. An information processing method according to 
claim 88, wherein said information that Is received 
as an object for conversion Is either a text docu- 
ment, an image format, a specific printer description 

10 language, or a document description language. 

93. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 
form printing, said program comprising codes for 

IS causing said computer to perform: 

a reception step of receiving information to be 
printed and a first printing parameter; 
a determination step of employing said informa- 
20 tlon that Is received to determine a second pa- 

rameter suitable for said information; 
a setup step of setting up said first and said sec- 
ond parameters; and 

a printing step of printing said Information 
25 based on said first and said second printing pa- 

rameters set up at said setup step. 

94. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 

30 form printing, said program comprising codes for 
causing said computer to perform: 

a reception step of receiving Information to be 
printed; 

35 an identification step of identifying a user for 

said information that is received; 
a printing step of printing said information; 
a printing results storage step of storing printing 
results in one of a plurality of storage locations; 

40 and 

a control step of storing printing results at a dif- 
ferent location for each user who is Identified at 
said identification step. 

45 95. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 
form printing, said program comprising codes for 
causing said computer to perform: 

so a communication step of communicating with 

an external device; 

an output step of outputting information; and 
a control step of requesting information from 
said external device, of receiving said informa- 
55 lion from said externa! device, and of permitting 

said output device to output said information. 

96. A computer-readable storage medium storing a 
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printing program for controlling a connputer to per- 
fornn printing, said program comprising codes for 
causing said connputer to perform: 

a communication step of communicating witli 
an external device; 
an input step of receiving information; 
a processing step of processing said informa- 
tion received at said input step; and 
a control step of transmitting said information 
to said external device at said communication 
step and of requesting said external device to 
process said information. 

97. A computer-readable storage medium storing a 
printing program tor controlling a computer to per- 
form printing, said program comprising codes for 
causing said computer to perform: 

an output step of outputting information; 
an acceptance step of accepting an output In- 
struction, including designation Information In- 
cluded for the designation of an output device; 
a detection step of detecting an apparatus that 
is Identified in said designation information; 
an output control step of permitting said output 
means to execute said output instruction when 
said apparatus detected at said detection step 
is a locally own information processing appara- 
tus, and of transmitting said output instruction 
to an external device when said apparatus de- 
tected at said detection step Is other than said 
information processing apparatus. 

98. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 
form printing, said program comprising codes for 
causing said computer to perform: 



mined process required for the performance of 
said process received at said reception step; 
and 

an output step of outputting the results obtained 
s at said processing step. 

100. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 
form printing, said program comprising codes for 

10 causing said computer to perform: 

a reception step of receiving designation infor- 
mation that Identifies a target to be processed; 
an acquisition step of acquiring said target 
15 identified in said designation information re- 

ceived at said reception step; 
a processing step of performing a process for 
said target acquired at said acquisition step; 
and 

20 an output step of outputting the results obtained 

at said processing step. 

101. A computer- readable storage medium storing a 
printing program for controlling a computer to per- 

25 form printing, said program comprising codes for 
causing said computer to perform: 

a reception step of receiving information to be 
processed; 

30 a processing step of processing said informa- 

tion; and 

a conversion control step of controlling a con- 
version of said information that is received at 
said reception step into Information, described 
3S using a description language, that is to be proc- 

essed at said processing step. 



a processing step of processing Information; 40 
a management step of receiving information to 
be processed from said external device through 
a communication unit for communicating with 
said external device, and of managing said in- 
formation by employing a plurality of manage- 45 
ment states. Including a process pending state 
and a process wait state; and 
a control step of permitting said processing 
means to process said Information. 

so 

99. A computer-readable storage medium storing a 
printing program for controlling a computer to per- 
form printing, said program comprising codes for 
causing said computer to perform: 

55 

a reception step of receiving a process to be 

performed by another device; 

a processing step of performing a predeter- 
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DATE: NOV 25, 1996 

TO: MACROHARD CORP. 
ATTN: MR. JOHN SMITH 
TEL: 00M-(415)-394-1111 
FAX: 001-1-(415)-394-2312 

FROM: CANON INC. 
SENDER: DR. ROHRA 
TEL: +81-44-543-3333 
FAX: +81-44-543-5555 



DEAR SIR, 

THANK YOU FOR YOUR PHONE CALL THIS MORNING. 

PLEASE FIND ENCLOSED HERE WITH THE INFORMATION REGARDING THE 
HOTEL ACCOMMODATION AND OTHER TRAVEL INFORMATION FOR YOUR 
FORTH COMING TRIP TO JAPAN. I WILL BE COMING TO YOKOHAMA CITY AIR 
TERMINAL TO PICK YOU UP. HENCE KINDLY CALL ME AT MY RESIDENCE. 
ARER YOU BOARD THE LIMOUSINE BUS. 

HOTEL ACCOMMODATION FOR YOUR TRIP IS AS FOLLOWS: 
HOTEL: SHIN-YOKOHAMA PRINCE HOTEL 
PERIOD OF STAY: 18TH DEC 1996 - 22ND DEC 1996 (4 NIGHTS) 



HAVE A PLEASANT JOURNEY, 
WITH REGARDS, 



(ARUNA ROHRA) 
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DATE: NOV 22, 1996 




TO: CANON INC. 

ATTN: DR. ARUNA ROHRA 

TEL: +81-44-543-3333 
FAX: +81-44-543-5555 


FROM: MACROHARD CORP. 
SENDER: MR. JOHN SMITH 
TEL: (415)-394-1111 
FAX: (415)-394-2312 


DEAR DR. ROHRA. 




THANK YOU FOR YOUR FAX. 




1 WILL BE REACHING YOKOHAMA AT 3:00 PM ON 28TH NOVEMBER. 
SINCE 1 AM COMING FOR THE FIRST TIME TO YOKOHAMA AND AS 1 AM NOT VERY 
FLUENT IN JAPANESE, 1 WOULD BE GRATEFUL IF YOU COULD KINDLY MEET ME AT 
THE STATION. 


THANKING YOU. 




YOURS SINCERELY, 




JOHN SMITH 
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SYSTEM: YOU ARE SUPPOSED TO MEET MR. JOHN ON 28TH, 
BUT WHAT WOULD YOU DO ? 

USER: ASK MR. TANAKA TO MEET HIM, WILL YOU ? 

SYSTEM: CERTAINLY. 
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SUBJECT: JOHN'S VISIT 

DATE: FRI, 23 NOV 1996 17:57:22+0900 

FROM: IDCP < IDCP@abc.canon.co.jp > 

REPLY-TO: IDCP < IDCP@abc.canon.co.jp > 

ORGANIZATION: CANON INC. 

TO: tanaka@dos.canon.co.jp 

REFERENCES: 



MR. JOHN ARRIVES AT YOKOHAMA ON 28TH. ROHRA WOULD LIKE 
YOU TO MEET HIM AND TAKE CARE OF HIM. 



I ATTACH THE FACSIMILE FROM HIM FOR YOUR REFERENCE. 
THANK YOU. 



-YOUR FAVOURITE FRIEND! ;-) 



141 



EP 0 851 384 A2 



FIG. 95 



NO 



YES 



( START ^ 



RECOGNIZE INPUTTED 
DOCUMENT 



S950 



USER HAS TO DO ANY 
ACTION ? 



YES 



PROXY MAY EXECUTE 
ACTION ? 



NO 



ANY USER ? 



NO 



EXECUTION OF ACTION 
REQUIRED ? 



NO 



C END ) 



S951 

S952 

S953 
YES 



1 



S954 



INQUIRE USER 



T 



S955 
YES 



1 



S956 



EXECUTE ACTION 



142 



EPO 



851 384 A2 




143 



EP 0 851 384 A2 




144 



EP 0 851 384 A2 



SELECT 
DXUMENT 
TO BE 
PRINTED 

FILE A 
FILE B 
FILE C 



FIG. 98 




DETERMINE 
NUMBER OFy 
COPIES 



(11 COPY § 



A CO. MR. a 
B CO. MR. b 
C CO. MR. c 



145 



EP 0 851 384 A2 



FIG. 99 

C START ) 




TRANSMIT REQUEST 
SIGNAL OF TARGET UNIT 
IDENTIFICATION SIGNAL 








^^-^-^•^-^ S993 
^ — ANY ^""""■^-O' 

inFNTIFinATION ^--^NO 


SIGNAL ? 
]pYES 


^S994 



DISPLAY UI CORRESPONDING 
TO IDENTIFICATION SIGNAL 



C END ) 



146 



EP 0 851 384 A2 



FIG. 100 



C START ) 




TRANSMIT TARGET UNIT 
IDENTIFICATION SIGNAL 



C END ) 



147 



EP 0 851 384 A2 



FIG. 101 



961 



1 — 


ft^ — ' 




! 







Select ^ 
document to 

BE PRI^^"ED 

FILE A 

FILE B 
. FILE C J 




DETERMINE 
NUMBER OF 
COPIES 

[1] COPY V 



SELECT 
DESTINATION 
A CO. MR. a 
B CO. MR. b 
V^CO. MR. c 




/^SELECT ^ 
DOCUMENT TO 
BE PRINTED 

FILE A 

FILE B 
. FILE 0 . 



SELECT 
DEVICE 
WHICH YOU* 
WISH TO USE 




SELECT 
DOCUMENT 
TO BE 
PRINTED 

FILE A 
FILE B 
FILE C 




DETERMINE 
NUMBER OF 
COPIES 

[1] COPY # 




SELECT 
DESTINATION 

A CO. MR. a 
B CO. MR. b 
C CO. MR. c 



I J wr I V 1 \y mn. u/ 



DETERMINE 
NUMBER OF 
COPIES 



(1) COPY 0 




SELECT 
DESTINATION^ 



A CO. MR. a 
B CO. MR. b 
C CO. MR. c 




148 



EP 0 851 384 A2 



FIG. 102 



C START ) 




TRANSMIT UI REQUEST 
SIGNAL 












81023 


■"^^ ANY UI ? 






^ YES 


^S1024 



DISPLAY RECEIVED UI 



C END ) 



149 



EP 0 851 384 A2 



FIG. 103 



C START ) 




TRANSMIT UI 



( END ^ 



150 



EP 0 851 384 A2 



FIG. 104 




151 



EP 0 851 384 A2 



FIG. 105 



C START ^ 



S1051 

ANY ^ 
INSTRUCTIONS NO 
OPERATION ? 



YES 



SEND REMOCON 
IDENTIFICATION INFORMATION 
AND UI REQUEST SIGNAL 



31 052 




DISPLAY RECEIVED UI 



S1054 



C END ^ 



152 



EP 0 851 384 A2 



FIG. 106 



( START ) 







SI 061 






REQUEST 



SIGNAL ? 
YES 



TRANSMIT REMOCON 
IDENTIFICATION INFORMATION 
AND TARGET UNIT IDENTIFICATION 

INFORMATION TO FILING SERVER 



S1062 



( END ) 



153 



EP 0 851 384 A2 



FIG. 107 



C START ^ 




S1072 



TRANSMIT UI AS SHOWN IN TARGET 
UNIT IDENTIFICATION SIGNAL TO 
REMOCON AS SHOW IN REMOCON 
IDENTIFICATION INFORMATION 



C END ) 



154 



EP 0 851 384 A2 



FIG, 108 




(Hm FAX. TRANSMlf 
UI TO SENIOR 
REMOCON B. 



1041 



HERE FAX. TRANSMIT 
UI TO BEGINNER 
REMOCON A. 



r-7c^ ' 






— 1 







y^96i 



TO: REMOCON B ^ 
SELECT DESTINATION 
A CO. MR. a 
B CO. MR. b 





REMOCON A 
SELECT 
DESTINATION 
A CO. MR. a 
B CO. MR. b 
C CO. MR. c 



HERE BEGINNER^ 
REMOCON A. 
VSEND UI. 



SELECT 
DEVICE 
WHICH YOU 
WISH TO USE 



HERE SENIOR^ 
REMXON B. 
V ^END UI. 

960a 




SELECT 
DEVICE 
WHICH YOU< 
WISH TO USE 



^960b 



/^SELECT DESTINATION^ 
A CO. MR. a 
8 CO. MR. b 



MULTI-ADDRESS 
COMMUNICATION 



SELECT 
DESTINATO 

A CO. MR. a 
B CO. MR. b 



MULTI-ADDRESS 
COMMUNICATION 




SELECT DESTINATION^ 
A CO. MR. a 
8 CO. MR. b 
C CO. MR. c J 



SELECT 
DESTINATO 

A CO. MR. a 
B CO. MR. b 
C CO. MR. c 




15S 



EP 0 851 384 A2 



FIG. 109 



( START ) 




DISPLAY RECEIVED UI 



C END ) 



156 



EP 0 851 384 A2 



FIG. 110 



( START ^ 




INFORMATION. USER IDENTIFICATION 
INFORMATION, AND TARGET UNIT 
IDENTIFICATION INFORMATION TO 
FILING SERVER 



( END ) 



157 



EP 0 851 384 A2 



FIG. 111 

( START 




UNIT IDENTIFICATION INFORMATION 
AND USER IDENTIFICATION INFORMATION 
TO REMOCON AS SHOWN IN REMOCON 
IDENTIFICATION INFORMATION 



C END ) 



FIG. 112 





BEGINNER 


SENIOR 


FAX 


STANDARD UI 


STANDARD UI 
+MULTI-ADDRESS 
COMMUNICATION UI 



EP 0 851 384 A2 



FIG. 113 




TO.- REMOCON A 
SELECT DESTINATION 

A CO. MR. a 
B CO. MR. b 
^ C CO MR. c . 



HERE REMOCON A. 
MAKE READY FOR FAX 
^COMMUNICATION I 
> ^ 




SELECT DESTINATION 
A CO. MR. a 
B CO. MR. b 
C CO. MR. c 




159 



EP 0 851 384 A2 



FIG. 114 



TRANSMIT 
DOCUMENT 
TO MR. a ! 











— 1 




f ~1 




MAKE READY 
FOR TRANSMISSION OF 
^D OCUMEN T TO MR. a i 

a. 



960 



SELECT 
DESTINATION 

\ A CO. MR. a 
B CO. MR. b 
C CO. MR. c 



160 



EP 0 851 384 A2 



FIG. 115 




161 



EP 0 851 384 A2 



FIG. 116 



C START ^ 




SEND REMOCON ID INFORMATION^' 
AND UI REQUEST SIGNAL 



S1 162 






YES 


DISPLAY RECEIVED UI 







( END ) 



-S1166 



S1164 
NO 




SEND REMOCON ID 
INFORMATION AND UI 
REQUEST SIGNAL VIA 
ANOTHER ROUTE 



-S1165 



162 



EP 0 851 384 A2 



FIG. 117 



TOM'S DOCUMENT 
HAS BEEN TRANMITTED 
TO MR. a 





FAX DXUMENT 
TO: A CO. MR. a 



WE HAVE BEEN ORDERED 
REGARDING THE MAHER. 

TOM 



MR. TOM TRANSMITTED 
FILE ABC TO MR. a OF 
A CO., LTD AT 10:00 AM 
ON JULY 5, 1996. 



I AM TOM. 
TRANSMIT 
DOCUMENT 
TO MR. a ! 




960 




163 



EP 0 851 384 A2 



FIG. 118 



( START ^ 




INFORMATION, USER IDENTIFICATION 
INFORMATION AND REQUEST SIGNAL 
CORRESPONDING TO INSTRUCTIONS 




DISPLAY RECEIVED UI 



( END ) 



164 



EP 0 851 384 A2 



FIG. 119 



( START ) 




CORRESPONDING TO 
REQUEST SIGNAL 



TRANSMIT REMOCON IDENTIFICATION 
INFORMATION, USER IDENTIFICATION 
INFORMATION, TARGET UNIT 
IDENTIFICATION INFORMATION, AND 
IMPORTANT INFORMATION RELATED 
TO EXECUTED ACTION TO FILING 
SERVER 



S1 193 



C END ) 



165 



EP 0 851 384 A2 




RESERVE RECEIVED 
INFOR MATION 

I 



r 



SI 202 



UPDATE HISTORY 
INFORMATION 



SI 203 



TRANSMIT UI AS SHOWN IN 
TARGET UNIT IDENTIFICATION 
INFORMATION AND USER 
IDENTIFICATION INFORMATION 
TO REMOCON AS SHOWN IN 
REMOCON INFORMATION 



81204 



( END ^ 



166 



EP 0 851 384 A2 



FIG. 121 



TIME 


DIRECTOR 


ACTION 


1996/7/5 10:00 


TOM 


TRANSMIT FILE ABC TO A CO. MR. A 


1996/7/3 18:50 


MARY 


TAKE TEN COPIES OF FILE XYZ 



167 



BP 0 851 384 A2 



FIG. 122 




:>=:=: >^963 




FAX DOCUMENT 
TO: A CO. MR. a 

WE HAVE BEEN ORDERED 
REGARDING THE MATTER. 

TOM 



MR. TOM TRANSMITTED 
FILE ABC TO MR. a OF 
A CO., LTD AT 10:00 AM 
ON JULY 5. 1996. 




I AM TOM. 
SHOW 
^HISTORYj^ 



960 



HISTORY 
17/5 FILE ABCy 




168 



EP 0 851 384 A2 



FIG. 123 




169 



EP 0 851 384 A2 




1265 



170 



EP 0 851 384 A2 



FIG. 127 



CHANGE IN ENVIRONMENT, 
CHANGE IN STATUS OF TASK 
FROM OTHER EQUIPMENT 



USER'S OPERATION 



TASK RECEIVE 
UNIT 



t 



41 



OPERATION 
UNIT 



TASK TABLE 



44 



TASK ANALYSIS 
UNIT 

I 



PLANNING 
DECISION UNIT 

I 



PROCESS 
EXECUTE UNIT 



-45 



-46 



-47 



A' 



OPERATION 
DATA 



INFORMATION PROCESSING 
APPARATUS 



1 



PAST SUCH AS INFORMATION 
TO ANOTHER EQUIPMENT 









TASK RECEIVE 
UNIT 




OPERATION 
UNIT 




OPERATION 
DATA 






1 




TASK TABLE 




TASK ANALYSIS 
UNIT 






1 




PUNNING 
DECISION UNIT 




1 




PROCESS 
EXECUTE UNIT 






^ 


INFORMATION PROCESSING 
APPARATUS 







RESULTS OF EXECUTION SUCH AS 
FILING, PRINTING AND DISPLAY 



171 



EP 0 851 384 A2 



FIG. 128 



( START ^ 



INITIALIZE TASK TABLE K 



S51 




1 



ADD RECEIVED TASK 
TO TASK TABLE 



15- 



S54 




OBTAIN MOST 
PREFERENTIAL TASK 



ANALYZE AIM OF TASK 



S56 



PLANNING • DECISION 



If 



S57 



EXECUTE PROCESS 
ACCORDING TO 
PLANNING 



if 



S58 



ADD NEW TASK TO 
TASK TABLE 



S59 



172 



BP 0 851 384 A2 



FIG. 



FIG. 



FIG. 



129A 

61 



START CONDITION 



^IDLING FOR PREOETERMINO 
/ PERIOD OF TIME 



CONTENTS OF TASK 



MAKE( 

Object: IDLE PERIOD TASK) 



129B 

62 



FIG. 129C 



63 



FIG. 129D 



64- 



.65 



FIG. 129E 



65 





START CONDITION 


CONTENTS OF TASK 


UNCONDITIONAL 


ANALYZE ( 

Object: RECEPTION INFORMATION 
rPrint "contract-doc* from Bj ) 


IDLING FOR PREDETERMIND 
PERIOD OF TIME 


MAKE( 

Object: IDLE PERIOD TASK) 




START CONDITION 


CONTENTS OF TASK 


UNCONDITIONAL 


PRINT ( 

Object: "conlractdoc" 
=PULL( 
Actor: A 

Object: < contract.doc> 
lobject: B )) 


IDLING FOR PREDETERMIND 
PERIOD OF TIME 


MAKE{ 

Object: IDLE PERIOD TASK ) 




START CONDITION 


CONTENTS OF TASK 


UNCONDITIONAL 


PULL( 
Actor: A 

Object: < contract.doc> 
lobject: B)) 


UNCONDITIONAL 


PRINT ( 

Object: <contract.doc> 
=PULL) 


IDLING FOR PREDETERMIND 
PERIOD OF TIME 


MAKE{ 

Object: IDLE PERIOD TASK) 




START CONDITION 


CONTENTS OF TASK 


UNCONDITIONAL 


PRINT ( 

Object: < contract.doo 
=PULL) 


IDLING FOR PREDETERMIND 
PERIOD OF TIME 


MAKE( 

Object: IDLE PERIOD TASK ) 





66 



.IDUNG FOR PREDETERMIND 
/ PERIOD OF TIME 



MAKE( 

Object: IDLE PERIOD TASK ) 



173 



EP 0 851 384 A2 



F/G. 130 

KOSUGI 




73- 



SET TRANSFER STATION 

AND CONDITIONS 
~<TRANSFER STATIONS> 
IPRINTER AT KOSUGI 



COPIER AT SHIMOMARUKO 

<CONDITI0N> 

fr 



UI FOR FAX 



72- 



DESIGNATE DEVICE 
THAT YOU WANT 
TO OPERATE 



ISHINKAWASAKI MY FAX! 




KOSUGI 



PRINTER 



UI FOR COPIER 



174 



EP 0 851 384 A2 



F/a 



131 

KOSUGI 



NEW YORK 




82- 



SHIN KAWASAKI 

m 






SELECT 
NUMBER OF 
COPIES 

(1) COPY $ 




COPY SEND 



SELECT 
NUMBER OF 
COPIES 



niCOPY $ 




COPY SEND 



77 

PRINTER 



SHIMOMARUKO 



UI FOR COPIER 




OPERATION 
PANEL 34 



TRANSMIT DOCUMENT TO 
MR. a OF A CO., LTD 



OBTAIN TRANSMISSION 
FUNCTION 



SELECT 
DESTINATION 




A CO., LTD, MR. a 
B INC. , MS. b 
C CORP. . MISS, c 



UI FOR TRANSMISSION 



175 



EP 0 851 384 A2 



FIG. 132 



A111 CONFERENCE ROOM 




93 



DISPUY PRESENT PLACE 
ON <MyDesk> 



1^ 



J 



91 

COPIER 





92 



NOW IN CONFERENCE 

(SHIMOMARUKO A111 
CONFERENCE ROOM) 



<MyDesk> 



176 



EP 0 851 384 A2 



FIG. 133 



SHIMOMARUKO 



REQUEST 
"contract-doc" 



1332 




DEVICE B 

PRINTER/SCANNER/ 
DESKTOP/ 
FILING SERVER 



1334 

A 

Contract.doc 



KOSUGI 



PLEASE FETCH 
"contracLdoc" FROM B 
.AND PRINT IT. 

^ ^ 

1333 





PRINTER A 
1331 



Contract 



177 



EP 0 851 384 A2 



FIG. 134 



115 



Contracldoc 



111 



i 



SCANNER 



FILING TO FILING SERVER 
TITLE, INDEX EXTRACTION 

i> 



113 



112 



Z 




I 



LI 



114 



WEB BROWSER 



FILING SERVER 



178 



EP 0 851 384 A2 



FIG. 135 



ACTION: SEND 
WHAT: abc.doc 
FROM: FILING SERVER 




179 



EP 0 851 384 A2 



FIG. 136 

TASK = COMMUNICATION (A, B. INFORMATION) 



F/G. laSA 

C START ) 



CONTACT B 



< 
< 



S1312 



ANY REPLY 
FROM B ? 



^81313 

'no 



YES 



REPLY = 

WILL CALLBACK 



^81319 

'no 



YES 



81320 



FIG. 136A 



FIG. 1368 



NECESSARY TO 
NOTIFY USER ?. 



_^S1314 
^ES 



S1315 



NOTIFY 



NO 



NECESSARY TO 
EXECUTE PRESENT 
.TASK AGAIN ? 



^51316 
.YES 



S1317 



ADD TASK TO 
TASK TABLE 



NO 



DELETE TASK AND 
ADD TO FAILED LIST 



S1318 



-^NECESSARY TOXYES ^-^yp^ 
vNOTIFY USER ?/ NUiiMr_ 




NO 


r 


^81322 


ADD TASK TO 
TASK TABLE 
KEEP IN MIND OF 
LATER CALL BACK 



S1321 



® 



180 



EP 0 851 384 A2 



FIG. 136B 

f 



< 



'REPLY = 




.CONTACT UTER ?^ 






REPLY 


= 0K ? 



S1323 
YES 

^81324 
NO 



® 



S1331 ® 



DISPLAY ERROR 
MESSAGE 



YES 



NECESSARY TO CONDUCT 
.NEGOTIATIONS ? 



^^81325 



81 326 



NEGOTIATE 



NO 



TRANSMIT 
INFORMATION TO B 



81327 



< 



ANY REPLY 
RECEPTION ? 



YES 



ANY NECESSARY 
ACTION ? 



j51328 
NO 

SI 329 
NO 



® 



YES 



ADD ACTION TO 
TASK TABLE 



81 330 



C END ^ 



181 



EP 0 851 384 A2 



FIG. 137 

TASK = PULL (A. B. INFORMATION) 



FIG. 137A 



FIG. 137B 



FIG. 137 A 

C START~~^ 



CONTACT B 



< 



S1412 



ANY REPLY 
FROM B ? 



^81413 
MO 



® 



S1414 



< 



uYES 



REPLY = 
WILL OA 



LBACK ?. 



YES 



JS1419 
.NO 

1 



81 420 



NECESSARY TOXYES. 
NOTIFY USER ? 



S1415 



NOTIFY 



NO 



NECESSARY TO 
EXECUTE PRESENT 
vTASK AGAIN ? 




S1417 



ADO TASK TO 
TASK TABLE 



NO 



DELETE TASK AND 
ADD TO FAILED UST 



S1418 



NECESSARY TONj:ESj r^S1421 
NOTIFY USER ?X 1 NOTIFY \ 
NO 



® 



ADD TASK TO 
TASK TABLE 
KEEP IN MIND OF 
LATER CALL BACK 



S1422 



182 



EP 0 851 384 A2 



FIG. 137B 

< 



^REPLY = 
.CONTACT LATER ?. 



SI 423 
YES 



<D 



REPLY = OK ? 



JS1424 
.NO 



SI 431 (b) 



DISPLAY ERROR 
MESSAGE 





YES 


.SI 425 S1426 


NECESSARY TO CONDUCTXYES 
NEGOTIATIONS ? y ' 


NEGOTIATE ' 



NO 



TRANSMIT INFORMATION 
REQUISITION TO B 

/ANY INFORMATIONXNO 



SI 427 



S1428 



vRECEPTION ? 



■© 



YES 



ANY NECESSARY 
ACTION ? 



^S1429 
^NO 



YES 



ADD ACTION TO 
TASK TABLE 



1^ 



SU30 



C END 



183 



EP 0 851 384 A2 



FIG. 138 

TASK = PUSH (A, B, INFORMATION) 



FIG. 138A 



FIG. 138B 



F/G. 138A 

C START :) 



CONTACT 8 



< 



S1513 



ANY REPLY 
FROM B ? 



YES 



REPLY = 

WILL CALLBACK ? 



YES 




.^NECESSARY TO^ 
\NOT|FY USER ? 



^S1514 
vYES 



S1515 



NOTIFY 



NO 



NECESSARY TO 
EXECUTE PRESENT 
TASK AGAIN ? 



NECESSARY TO 
NOTIFY USER ? 



^51520 
.YES 




S1517 



ADD TASK TO 
TASK TABLE 



,rNO 



DELETE TASK AND 
ADD TO FAILED LIST 



S1518 



NOTIFY 



NO 



S1521 



® 



ADD TASK TO 
TASK TABLE 
KEEP IN MIND OF 
LATER CALL BACK 



S1522 



184 



EP 0 851 384 A2 



FIG. 138B 



REPLY = 
XONTACT LATER ?> 



S1523 
YES 



NO 



SI 524 



REPLY = OK ? 



81531 (D 



YES 



^NO ^ 


DISPLAY ERROR 






MESSAGE 





, ][ ^^81525 S1526 

NECESSARY TO CONDUCfXYES, i MrrnTmr l 
NEGOTIATIONS ? NEGOTIATE | ' 

jNO , -.c,i.,P7 



TRANSMIT NECESSARY 
INFORMATION TO B 



< 



ANY REPLY 
RECEPTION ? 



YES 



ANY NECESSARY 
ACTION ? 




YES 



ADD ACTION TO 
TASK TABLE 



SI 530 



C END ^ 



185 



EP 0 851 384 A2 



FIG, 139 

TASK = INDICATE (A, B, INSTRUCTION INFORMATION) 



FIG. 139A 



FIG. 139B 



FIG. 139 A 

C START ^ 

81 61 2 



CONTACT bP 0 

I ^ S1613Y ^51614 SI 61 5 

^KX^PI^k^ L/NECESSARY T0V1§J motifC1 

FROM B ? y ^ \NQTIFY USER 1? H NOTIFY 

I YES ^ S1619 I NO 

EPLYT CnO r §1616 .S1617 



REPLY = 
WILL OA 



LLBACK ? 



YES 



1 



^NECESSARY TO 
EXECUTE PRESENT 
JASKAGAIN ? 



^51616 
vYES 



ADD TASK TO 
TASK TABLE 



NECESSARY TO 
NOTIFY USER ? 



^S1620 
^ES 



uNO 



DELETE TASK AND 
ADD TO FAILED LIST 



S1618 





NO 




^S1622 


ADD TASK TO 


TASK TABLE 




KEEP IN 


MIND OF 




LATER CALL BACK 





NOTIFY f 



SI 621 



® 



186 



EP 0 851 384 A2 



F/G. 139B 



REPLY = 
.CONTACT LATER Z, 



,81623 
YES 



< 



NO 



REPLY = OK ? 



^81624 

.NO 



S1631 ® 



DISPLAY ERROR 





YES 


.S1fi?f5 S162fi 


NECESSARY TO CONDUCfXYES 
NEGOTIATIONS ? j/ " 


NEGOTIATE 1 



TRANSMIT INSTRUCTIONS 
INFORMATION TO B 



< 



S1627 



ANY REPLY 
RECEPTION ? 



YES 



ANY NECESSARY 
ACTION ? 



^S1628 
^NO 

^S1629 
NO 



^ YES 

ADD ACTION TO K 
TASK TABLE 



S1630 



C END ) 



187 



EP 0 851 384 A2 



FIG. 140 

TASK = RESPOND (B. A. REQUEST) 



FIG. 140A 



FIG. 140B 



FIG. 140A 



( START ) 



S1712 



SI 71 9 



REQUEST TYPE 
= CONTACT ? 



jYES 



5^ 



REQUEST TYPE \YES 
INFORMATION REQUEST ?> 



SI = PRESENT STATUS/ K 
USER SET UP 



® 



S1713 



< 



NO 



SI 721 



REQUEST TYPE \YES 
PUSH INFORMATION 



NO 



REQUEST TYPE 
INSTRUCTIONS ? 



NO 



S1723 

5^ 



S1720 



RESPOND 
/INFORMATION \ 

REQUEST Ti'PE 
VREQUEST / 



SI 722 



RESPOND 
/INFORMATION \ 

STORAGE WPE 
VREQUEST / 



SI 724 



RESPOND 
/ INSTRUCTIONS \ 
TYPE 

\INFORMATION / 



OPTIMAL REPLY 



S1725 



® 



188 



EP 0 851 384 A2 



FIG. 140B 



1 



.S1714 



NO/SI = VERY BUSY/ 

STANDBYMODEJ, 

;YE$ ^^ 81715 

COMPLIANCE WITH \ NO 



< 



REQUEST ? 



uYES 



S1716 



REPLY = WILL CALLBACK 



REPLY = OK 



S1718 



81717 



REPLY = CONTACT LATER 



C END ^ 



189 



EP 0 851 384 A2 



FIG. 141 

RESPOND (TO B, A, INFORMATION REQUEST TYPE REQUEST) 



( START ) 



•S1812 

'necessary TO conductX^es 

.NEGOTIATIONS ? 



81813 



NEGOTIATE 





,N0 


FETCH INFORMATION 







S1814 
SI 81 5 



NO 



YES ^ 81817 



S1821 


< 






ADD TASK "TRANSFER" 


TO TASK TABLE 


SI 822 






r 


REPLY = OK 



S1816 



REPLY = NG 



YES 



NECESSARY TO 
FORMAT/CONVERT IT ? 



.S1818 
NO 



SI 81 9 



YES 



CONVERT 
INFORMATION 



TRANSMIT INFORMATION 



S1820 



C END ) 



190 



EP 0 851 384 A2 



FIG. 142 

RESPOND (TO B, A, INFORMATION STORAGE TYPE REQUEST) 



( START ) 



S1912 

NECESSARY TO CONDUCTXYES 
.NEGOTIATIONS ? 



S1913 



NEGOTIATE H 



I 



NO 



ACQUIRE INFORMATION 



S1914 



< 



ANY INFORMATION 
RECEPTION? 



S1915 
NO 



YES 



^ S1916 

f^2i_^ 

REPLY = NG 



NECESSARY TO 
FORMAT/CONVERT IT ? 



S1917 
NO 



YES 



^1 918 



CONVERT 
INFORMATION 



REPLY = 0K"| ^ 

( END / 



S339 



S340 



191 



EP 0 851 384 A2 



FIG. 143 

RESPOND (TO B, A, INSTRUCTIONS TYPE REQUEST) 
( START ^ 



.S2012 

'NECESSARY TO CONDUCf\YES 
.NEGOTIATIONS ? 



^201 3 
NEGOTIATE | - 



|N0 



INTERPRETE INSTRUCTI0NS^^ 
INFORMATION 



S2014 



EXECUTABLE 
INSTRUCTIONS ? 



S2015 
NO 



YES 



S2020 


\ 


ADD TASK (EXECUTION) 
TO TASK TABLE 


S2021 

REPL> 


r = OK 



tYES 



EXECUTE instructions! 






REPLY = 




EXECUTION RESULT 



r 



S2017 
S201B 



-S2019 



E 



c END 



S2016 



REPLY = NG 



192 



EP 0 851 384 A2 



FIG. 144 



DEVICE A 



/- 












i I 



DEVICE B 




CONTACT B 



START 



OK 



REQUEST DATA <abc> 

[in <xyz format>] 
MTRANS 
{Actor: A 

Object: MTRANS { 
Actor: B 
Object: <abc> 
lobjed: A 

Support: <xyz format>} 
lobject: B...} 



FETCH DATA <abc> 



CONVERT FORMAT 
(IF NECESSARY) 



CONVERT FORMAT 
(IF NECESSARY) 



EXECUTE APPROPRIATE 
ACTION ACCORDING TO 
DATA 



END 



TRANSMIT DATA <abc> 
MTRANS { 
Actor: B 
Object: <abc> 
lobject: A 

Support; <xyz format>} 



193 



EP 0 851 384 A2 



FIG. 145 



DEVICE A 





fP^T \ 


CD 






( 1 



CONTACT B 



START 



DESKTOP B 




OK 



REQUEST DATA <abc> 
[in <xyz format>] 



OK 

FETCH DATA <abc> 



OK 



CONVERT FORMAT 
(IF NECESSARY) 

EXECUTE APPROPRIATE 
ACTION ACCORDING TO 
DATA 



START 



END 



CONVERT FORMAT 
(IF NECESSARY) 

PRINT DATA <abc> 



194 



EP 0 851 384 A2 



FIG. 146 



DEVICE A 




DEVICE B 




CONTACT B 



START 



OK 



OBTAIN FILE LIST 



TRANSMIT FILE LIST 



DETERMINE DATA <abc> 
TO BE PRINTED 



REQUEST DATA <abc> 
[In <xyz format>] 



CONVERT FORMAT 
(IF NECESSARY) 



END 



FETCH DATA <abo 

CONVERT FORMAT 
(IF NECESSARY) 

TRANSMIT DATA <abc> 



EXECUTE APPROPRIATE 
ACTION ACCORDING TO 
DATA 



195 



EP 0 851 384 A2 



FIG. 147 




I — 




CD 




^ ] 




1 I 




PRINTER 



ACTION: 
WHAT: 



READ OUT 
NEW MAIL 



OK I I CANCEL 




FIG. 149 



IMAGE, DOCUMENT 
INFORMATION i 




DISPLAY 
MY SCHEDULE 




^ 



196 



EP 0 851 384 A2 



FIG. 148 



DEVICE A 







a 










{ I 
( - 1 



DESKTOP B 




CONTACT B 



START 



OK 



REQUEST DATA 

NEW MAIL IN <VOICE> 
MTRANS 
{Actor: A 

Object: MTRANS { 
Actor: B 

Object: New mail 
lobject: A 
Support: <Voice>} 
lobject: B ...} 



EXECUTE APPROPRIATE 
ACTION ACCORDING TO 
DATA 



END 



FETCH NEW MAIL 



CONVERT 
VOICE FORMAT 



TRANSMIT DATA 



MTRANS { 
Actor: B 

Object: {Mail from John..} 
lobject: A 
Support: <Voice>} 



SPEAK OUT INFORMATION 



FROM MR. JOHN, 

MASSAGE "WHEN IS UI DESIGN CLEAR 
FOR ME ?•• HAS BEEN MAILED. 

^ 



197 



EP 0 851 384 A2 



FIG. 150 





DOCUMENT READER 



ACTION: 

WHAT: 

WHOM: 



SEND & HOLD AT B 

DOCUMENT SCANNED THIS MORNING 

DEVICE B 



OK 



CANCEL 



198 



EP 0 851 384 A2 



FIG. 151 



DEVICE A 




DEVICE B 




CONTACT B 



START 



OK 



REQUEST TRANSMISSION ^ 

OF DATA <abc> 

TRANSMIT 

[<xyz> format] 



CONVERT FORMAT 
(IF NECESSARY) 



TRANSMIT DATA <abc> 
[in <xyz format>] 
+ HOLD 



RECEIVE DATA 

CONVERT FORMAT 
(IF NECESSARY) 

EXECUTE APPROPRIATE 
ACTION (HOLD) 
ACCORDING TO DATA 



199 



EP 0 851 384 A2 



FIG. 152 



SCANNER 



FILING TO FILING SERVERS B ANDCl 
TITLE AND INDEX EXTRACTION J 




B 

SCANNER 




FILING SERVER 



200 



EP 0 851 384 A2 



FIG. 153 



DEVICE A 



DEVICE B 




<abc> 




CONTACT B 



START 



OK 



WISH TO TRANSFER 
INFORMATION <abc> 
TO BE FIELD FOR USER 1 



TRANSMIT 
[<xyz> format] 



CONVERT FORMAT 
(IF NECESSARY) 

TRANSMIT DATA <abc> 

[In <xyz format>] 

& FILING TO FILINiS 
SERVER TITLE, 
INDEX EXTRACTION 



END 



RECEIVE DATA 

CONVERT FORMAT 
(IF NECESSARY) 

EXECUTE APPROPRIATE 
ACTION (FILING TO 
FILING SERVER TITLE, 
INDEX EXTRACTION) 
ACCORDING TO DATA 



201 



EP 0 851 384 A2 



FIG. 154 




PRINTER 



ACTION: 

WHAT: 

WHOM: 



SEND MAIL 

GET DESIGN FROM BILL 
JOHN 



OK 



CANCEL 



202 



EP 0 851 384 A2 



FIG. 155 



DEVICE A 



CONTACT B 



START 



DEVICE B 



NOW IN CONFERENCE 
<SHN0lylARUKO Atll 
CONFERENCE RCOM> 




OK 



NOTIFY GIVING 
INSTRUCTION 



CONVERT INSTRUCTION 
INTO RECOGNIZABLE FORMAT 
<xyz> type 
(IF NECESSARY) 



TRANSMIT 
RECOGNIZABLE 
FORM AT 
[<xyz> type] 



TRANSMIT INSTRUCTION 
DATA, [DISPLAY 
TNOW in CONFERENCE 
<SHIM0MARUKO A111 
CONFERENCE ROOM>JJ 



END 



RECEIVE DATA 



EXECUTE APPROPRIATE 
ACTION TO DISPLAY 
(TNOW IN CONFERENCE 
<SHIMOMARUKO A111 
CONFERENCE ROOM>J) 
ACCORDING TO DATA 



203 



EP 0 851 384 A2 



FIG. 156 



DEVICE A 



DEVICE B 





CONTACT B 



START 



OK 



NOTIFY GIVING 
INSTRUCTION 



CONVERT INSTRUCTION 
INTO RECOGNIZABLE FORMAT 
<xyz> type 
(IF NECESSARY) 



TRANSMIT 
RECOGNIZABLE 
FORM AT 
[<xyz> type] 



TRANSMIT INSTRUCTION _ 
DATA, rCONDITION SET UP 
riF DOCUMENT FROM MR.SUZUKI 
HAS JUST REACHED, THEN 
FORWARD IT TO MR. TOYODAJJ 



END 



RECEIVE DATA 



EXECUTE APPROPRIATE ACTION 
TO SET UP CONDITION THAT 
(ANY DOCUMENT SENT FROM 
MR. SUZUKI AND ADDRESSED 
TO USER SHOULD BE 
TRANSFERRED TO MR. TOYODA) 
ACCORDING TO DATA 



204 



EP 0 851 384 A2 



FIG, 157 



DEVICE A 



DEVICE B 



SCANNER 




CONTACT B 



START 



OK 



NOTIFY GIVING 

INSTRUCTION ^ 

TRANSMIT 

RECOGNIZABLE 

FORM AT 

CONVERT INSTRUCTION [<'«yz> type] 

INTO RECOGNIZABLE FORMAT 

<xyz> type 

(IF NECESSARY) 



TRANSMIT INSTRUCTION 
DATA. [TRANSMIT "abc.doc" 
TO MR. JOHN] 



END RECEIVE DATA 

EXECUTE APPROPRIATE 
ACTION (TRANSMISSION 
OF "abc.doc" FROM FILING 
SERVER TO MR. JOHN) 
ACCORDING TO DATA 



205 



EP 0 851 384 A2 



FIG. 158 



FILING SERVER 



— PATENT 

.PRODUCT 
SPECIFICATION 



OTHER CO. 
-h PRODUCT 
INFORMATION 



-r- aaa.txt 



abc.doc 



ccctxt 
xyz.doc 

A CO. 
B CO. 
— C CO. 

■'- D CO. 




DESTINATION 



INPUT DESTINATION 



JOHN 




FILING SERVER 



JOHN'S DESKTOP 



206 



EP 0 851 384 A2 



FIG. 159 



PRINT WINDOW 



DISPLAY READABLE INFORMATION 
COMPUTER STORED MEMORY 



NAME OF 
PRINTER 

NUMBER OF SETS 
TO BE PRINTED 




PRINTER X 



INSTRUCT PRINTER X 
TO EXECUTE PRINTING 
BASED ON CONTENTS 
SET BY USER 





It^ \ 


1 — 1 


— ^ 


( 1 
' 1 



207 



EP 0 851 384 A2 



F/G. 160 



C3 



REMOTE CONNECTION 



LOGIN: ichiro 
PASSWORD: 

LAST LOGIN: TUB FEB 4 16:03:18 FROM ABC 

YOU HAVE MAIL ! 
ichiro > 




208 



EP 0 851 384 A2 



FIG. 161 



COPY WINDOW (SCANNER Y) 



COPY 

DESTINATION 

NUMBER OF SETS 
TO BE COPIED 



PRINTER X 



0 



SETS 



PRINT 



CANCEL 




209 



EP 0 851 384 A2 



FIG. 162 



PRINT JOB 



OUTPUT RESULTS 



\ 



391 



INPUT JOB 
JUDGMENT UNIT 



1 



396 



OUTPUT UNIT 




HOLD JOB 
MANAGEMENT UNIT 




OUTPUT WAIT JOB 
MANAGEMENT UNIT 



393 



HOLD 

JOB 

TABLE 




397 



OUTPUTTED JOB 
MANAGEMENT UNIT 



395 



OUTPUT 
WAITING 
JOB 
TABLE 




398 



OUTPUTTED 

JOB 

TABLE 



399 



TASK TABLE 



210 



EP 0 851 384 A2 



FIG. 163 

PRINT (A, "abc.doc") OR PRINT (NOT A, "abc.doc") 



FIG. 163A 



FIG.163B 



FIG. 163 A 




EP 0 851 384 A2 



FIG. 163B 




CONVERT 

DOCUMENT 



S4008 



INDICATE 
CONVERSION 



S4010 




[5- 



S4009 



S4013 



RESERVE PRINTED FILE 
AS PRINTED JOB EXECUTE 
OTHER PROCESS 



DISPLAY ERROR K 

:i ' 



S4016 



C END ) 



212 



EP 0 851 384 A2 



FIG. 164 



414 



abc.doc 




SEND "abcdoc" 
TO PRINTER B ! 



411 

SCANNER A 



PRINTER B 
412 



PRINT HELD 
DOCUMENT I 



RESERVE "abc.doc" AS HELD JOB 
(NOT PRINTED OUT IMMEDIATELY) 



"abcdoc" IS CHANGED 
TO PRINT WAITING JOB 




SHOW HELD 

DOCUMENT ! 



"abcdoc" IS DISPLAYED 
ON PANEL 



"abcdoc" IS PRINTED 



415 



\ 




DELETE HELD 
DOCUMENT! 



"abcdoc" IS CHANGED 
TO PRINTED JOB 




"abcdoc" IS DELETED 
FROM HELD JOB 



DELETE PRINTED 
DOCUMENT ! 



abc.doc 



"abcdoc" IS DELETED 
FROM PRINTED JOB 



213 



EP 0 851 384 A2 

i 



FIG. 165 




JOBS 4201 
JOBS HELD 

4202 
JOBS IN QUEUE 

JOBS IN HISTORY 
'4203 



4204 



TITLE SENDER SOURCE PRIORITY STATUS 



JUPITER RAJNISH INNOVATION 



HIGH HELD 



4205 



4206 



4207 



PRINT 



HOLD 



EXTEND HOLD 



SEARCH 



SEND 



DELETE 



CHANGE PRIORITY 



SET INST. 



4208 



4209 



4210 



4211 



214 



